glad

BlogsNow internet

glad that BlogsNow is running again:
where else would I have found
tape failure ?

BlogsNow down for 12 days

BlogsNow

The machine that BlogsNow runs on still freezes with

CPU 0: Machine Check Exception: 0000000000000004
bank 4: b200000000070f0f

I have replaced Memory, CPU and motherboad. CPU got an up- and motherboard a slight downgrade. It runs for a couple of days, and then dies. After it dies it sometimes get’s back up only for a few hours. Once it has been down for more than 8 it will run for another four days or so. After every crash I have to fix the database, which takes 70 minutes. The fix of the autoincrement insert_id however takes even longer and took the machine out in the last 3 out of 2 uses. I am running an
i686 athlon i386 GNU/Linux kernel 2-6-9 with an 8 port 3ware card.

I really don’t feel like replacing this expensive card, but might need to.

BlogsNow was great, as long it was running smoothly. Now it needs allot of care, and I am considering to never turn it on again. It’s sad to leave the field to all these others attempts. None of them is convincing me. I would miss BlogsNow.
But that’s just me.

mysql

BlogsNow

During all those crashes due to faulty hardware I must have forgotten to fix the mysql database for BlogsNow before I used it. I had to remove som 800K blogs that all had insanly high index ids. Now I am trying to be a good boy and set the auto increment correct via:

alter table blog AUTO_INCREMENT number_here

Just that it seems to take for ever. The temp file and index file grow very erratic since one hour. I will let it cook for a couple of hours, but this looks fishy. 30 million entries should not be that much for mysql …

thirty million weblogs

BlogsNow communication confessions of a pixel pusher internet

Just crossed the thirty Million weblog mark at BlogsNow tracks. Jason installed new memory, CPU and motherboard on the machine eight hours ago. I hope that the random crashes (MCE …4 ) it had are now a thing of the past. But it still could be the raid controller that causes the troubles. We will see.

Thirty million blogs! It’s online since almost two years, ran on three different machines in three different hosting situations.

There are about a quarter million web-pages in google with the term BlogsNow. popurls has roughly the same number. I think popurls started two weeks ago.

I find it very interesting to compare BlogsNow and popurls. The later one shot to internet fame instantly while BlogsNow only caters to a small and very slowly growing audience. Popurls is better than what I wrote in many many hours. The actual implementation of popurls would have taken me a week. Of course I did BlogsNow and not popurls. And also obviously I have hoped for instant internet fame when I wrote the fastest memetracker possible.

Technically I achieved my goal. BlogsNow’ performance is unsurpassed: It will reliably track _everything_ that people talk about. I still like it better than all others.

But let’s have a look why popurls got what BlogsNow wanted so badly and could never get. Popurl’s author is the first to say that the concept of a meta meta tracker is hardly new: diggdot.us paved the way into the mainstream, but I think there have been others.

The implementation of popurls works, it’s simple and nothings gets in the way. The design is what matters. It turns out that the idea of a meta-meta-track added with decent-design adds up to go over the threshold to become a meme in itself.

In the new attention economy you have to raise the interestingness of something above an imaginary threshold. It is almost impossible to push something there. Not even the biggest media buy will get you there. If your concept is not worthy then every person in the chain works against your piece (work, meme whatever it is). The resistance will become infinite. Many companies have wasted millions of ad dollars in the last years by ignoring this simple fact. If your idea raises above this threshold then it will attract more multipliers along the way. It’s too bad that ‘viral marketing’ became such a bad rep, since all agencies attached it to their failing attempt. Real meme’s do indeed work very much like a virus. The big difference is that every ‘host’ has the ability to alter the ‘virus’. We give those links, files and words new meaning when we pass them on. We comment them and make them our own. I could not say that from that last cold I got from someone and also probably gave to somebody else. The term ‘viral’ already contains the arrogance of agencies: They think they just can ‘infect’ the audience and then save their client some money in the media buy. Of course that’s now how it works: Most of their ideas are simply not good enough to compete with what is out there. There were some single incidences where commercials got some viral traction. None of them made room for a follow up. ‘Viral Campaigns’ by their definitions are one hit wonders. With the broadening of the tools and people getting more connected every day the odds move against the traditional marketers use of viral campaigns. Does this have anything to do with a BlogsNow vs. popurls comparison? Hardly. How did we get here?

Popurls became an instant ‘meme’, BlogsNow did not. I think in very simple terms I think it comes down to the fact that design matters. Popurls is an instant hit since it instantly communicates. The natural reaction is :”this is nice. I want to use this.” Within those 2 seconds a website has with a new visitor it is able to convey what is different about it. It tells it’s story well. The ‘elevator pitch’ of the internet must be over before the user blinks another time. There are always ten real and hundreds of potential other sites comparing with the one you are looking at.

My son is seven. He wants to write a computer game. He found google, and was very frustrated, that could not find ANY instructions how to make a computer game for seven year olds after he entered his request into google. I never told him to google it, or even to research it on the internet. His experience is that the internet might as well contain all the answers to everything. It’s this unprecedented amount of instantly available content that is the evolutionary pressure on every meme out there. The pace in that online (media) experiences grow in their quantity, variety and maybe even quality is equally unprecedented. So is the spread of the audience and their level of engagement: 1 person, 1 computer with internet connection, 1 hour. To say that the range of experiences is huge would be an understatement. It is awing. And spreading. We have the user on dial with internet explorer trying to get some news about balinesian dancing to the CEO on a laptop playing WOW while being on a plane. These are not the two extremes. These are two random points in an infinitely complex cloud of usage patterns. Hundred people watch a movie in the cinema. Their experience is pretty similar, they don’t even need to have seen it the same place or at the same time. Watching an old black white movie is almost a time travel experience. Hundred people what the movie on TV and the possibilities broaden. It used to be that the whole country watched the same stuff. There was the concept of a “Straßenfeger” in Germany in the 60s. It meant that a specific radio or TV series had such a big draw that it would ‘clean the streets’ (from people). There are only few events left that can obtain this mass attraction. Hundred people watching the same movie on TV might do so from a DVD, on the seventieth rerun, because their Tivo thought they should be watching it, or just because they are waiting for the show that follow this program. These hundred people might pay attention or might not. Since TVs tend to everywhere and just run after you turned them on, it is also one of the most ignored media outlets there is. Hundred people watching a clip that they got on a computer one way or another will have the most diverse media experience.

It is in this jungle of possibilities that the ability to communicate your idea between two blinks becomes mandatory. The idea needs to be decent, and then it needs to be easy to understand. Popurls instantly tells you that it’s a decent looking meta-meta tracker. Just when you think, ah so many links it kicks some pretty pictures your way. Your peaking ‘into it’ will be rewarded. By the time you have seen the entire page (2.5 seconds into your visit) you will have glimpsed over nine headlines, at least three or four are known items. popurls is a good mix of known and the new. All known is boring and will be clicked over quicker then you can say ‘boring’. All new is confusing. People are usually not curious enough to give new things the time to understand them.

The good design of popurls makes it work. As an engineer I thought that people would understand the aspect that BlogsNow is faster and more comprehensive than anything else. Even though it is, I did not manage to communicate this. And maybe it does not even matter. The first meme trackers got the webs attention, because they were a new concept. The fastest one is not a big deal. It’s functional difference needs repeated use an comparative analysis to understand. Memetrackers are not that important that people would do this sort of analysis. BlogsNow is a classic example for the fact that people and projects overestimate their own importance. Many web 2.0 startups think that they are Moses coming down from the mount Sinai. BlogsNow first goal was that it would keep me up to date with what is going on on the internet. And BlogsNow I can trust and, if needed, even tweak to let it behave better. Enough reason to let it keep going for next thirty million blogs. Popurls is not the first too and certainly not the last tool that will surpass BlogsNow in the amount of web attention it gets. It just is such a clear case that engineering does not really matter. The upside is that it was and is fun to code the fastest Memetracker there is. That, my constant use, and the fact that I have a neat copy of what mattered on the web in the last two years is enough reasons to keep it going. Despite the fact that nobody cares 😉

temperature monitoring redhat fedora core 3 with asus A8V board

BlogsNow linux

BlogsNow started crashing. I wonder if it is the CPU temperature. Since I am a 5000 miles away from the computer I needed something to measure the temperature. This was harder to google to than it should be. In the end it was as simple as:


yum install lm_sensors
/etc/rc.d/init.d/lm_sensors start

sensors-detect
[accept all defaults]

sensors
[will output what the machine feels like]

now I need to copy this to another machine and then I know what happens when the machine dies.

A super simple monitoring way is to create an executable cgi file in your webservers path like this:

#!/bin/bash
echo Content-type: text/plain
echo ""
date
sensors

And then you wget / cron on a different machine to get the status and pipe it to one file …

is BlogsNow evil?

BlogsNow free of any reason


right now the rank number seems to indicate that
right now. I hope I go back an update this once the number has changed.

somebody is trying to give up memetrackers altogether

I sometimes I wish I could do that too. Tricky to check if the spam filters need a tweak by looking at the results and then not to click on something that people blog about right now.

Version 108

BlogsNow internet media

Version one hundred and eight of BlogsNow:

BlogsNow has feeds. With a twist, of course: the title contains ‘BlogsNow’ to make sure that people realise who brought them a topic first. Links click trhough BlogsNow so that I can see where which links get used and scraped. I also add the time in the link, so that I can see how long links linger out there. There are more rss bots than ever it seems. I am curious where the BlogsNow rss content will show up.

I then looked at the css file and messed around. Some people would call that a redesign. I would never attempt to consider my css dablings to be design. If I can read the text on the page then I am happy.

The logo did not feel right anymore, so I got rid of it. Which does not feel right either. Maybe I will have an idea. Yeah right.

Finally I added BlogsNow in the list of links. Click on the ‘x links’ below the subject and you can see the link history. Where did a topic show up when. Interesting to see how BlogsNow compares to other trackers.

Dick the hunter, blogs, BlogsNow and the others

BlogsNow internet

Mr Cheney shoots somebody in a hunting accident. No big deal really. The victim is up and well.

But it’s an interesting test of of all those meme trackers that are out there. I saw it first on BlogsNow, where it got listed one hour ago and occupies the number 1 spot with 50 links. Memeorandum has it as well. Also #1 there, not sure how long, there is Michelle Malkin and 3x an AP story as well as 6 links from the selected pool of sources they track.

All others however did not show the story at all when I visited them. I did build BlogsNow for speed and coverage. Looks like it does what it issupposed to do.

blogspot offline

BlogsNow google internet

Looks like most of blogger is offline from here and from where BlogsNow looks.
So I told the bot to stop trying.

I just hope that gmail is been maintained better than blogspot.
Then on the other hand: After installig a postfix server recently I might be tempted to
keep gmail only as a backup.

broken windows theory and splogs

BlogsNow google internet malware

You an apply the Broken Windows Theory at spam blogs as well. There was always ample opportunity for spammers in blogs. Now they are in, and they make revenue. So they enhance their spam blogs to stay in the game. Here two splogs out of a current campaign:

exhibit A
exhibit B

They certainly get better.