Slashdot Mirror


The Perception of 'Random' on the iPod

Robaato writes "Stephen Levy writes in the Guardian about the perception of randomness, or the lack thereof, on an iPod set to shuffle." From the article: "My first iPod loved Steely Dan. So do I. But not as much as my iPod did.... I didn't keep track of every song that played every time I shuffled my tunes, but after a while I would keep a sharp ear out for what I came to call the LTBSD (Length of Time Before Steely Dan) Factor. The LTBSD Factor was always perplexingly short." My first iPod shuffle refused to let me delete (sigh) Weird Al's Polkamon off of the flash memory.

292 comments

  1. And Zonk dupes himself... again... by Anonymous Coward · · Score: 5, Funny

    Is the iPod Shuffle Playing Favorites?

    How about an analysis of the randomness of Zonk dupes. I guess I should be happy it's not a games story.

    1. Re:And Zonk dupes himself... again... by strider44 · · Score: 4, Informative

      I think that the slashdot editors can be forgiven for posting a link to an article on a similar topic a year and a half later...

      That article is btw referenced in this one.

    2. Re:And Zonk dupes himself... again... by MobileTatsu-NJG · · Score: 1

      "And Zonk dupes himself... again..."

      To be fair, the other story was feb of 05. Dupes suck, but do you really expect Zonk to remember every single story he's posted?

      Besides, the article that was linked to was recent.

      --

      "I like to lick butts!" by MobileTatsu-NJG (#32700246) (Score:5, Informative)

    3. Re:And Zonk dupes himself... again... by Anonymous Coward · · Score: 1, Insightful

      I remembered it, and I didn't get paid to post it.

    4. Re:And Zonk dupes himself... again... by Anonymous Coward · · Score: 0, Troll

      Maybe it's time to get a life outside of Slashdot ...

    5. Re:And Zonk dupes himself... again... by MobileTatsu-NJG · · Score: 1, Offtopic

      "I remembered it, and I didn't get paid to post it."

      So? Do you remember every comment you've posted?

      --

      "I like to lick butts!" by MobileTatsu-NJG (#32700246) (Score:5, Informative)

    6. Re:And Zonk dupes himself... again... by Somatic · · Score: 1
      Even better, here's a quote from that thread:

      Hey, shut up! It's a new post and it's NOT a dupe. Let's not push our luck, OK?
      --
      My script don't crash! She crashes, you crashed her!
    7. Re:And Zonk dupes himself... again... by GarfBond · · Score: 2, Informative

      Not to mention it looks like Steven Levy essentially duped his own article for the Guardian, with the added benefit of time and history with the shuffle to make a conclusion.

    8. Re:And Zonk dupes himself... again... by tehshen · · Score: 1
      So? Do you remember every comment you've posted?

      I can't write a list of all of them, but if you give me a few, I can probably pick out the ones I remember.
      --
      Guy asked me for a quarter for a cup of coffee. So I bit him.
    9. Re:And Zonk dupes himself... again... by 3b0la_R0 · · Score: 1

      actually.. all these dupes are welcome.. at least for the new readers of slashdot...
      i've been reading it since last year and at this moment i find out that the dupes are ok..
      if there weren't any.. how would i find out about all this stuff?

      thanks! :)

      --
      --
    10. Re:And Zonk dupes himself... again... by The-Bobmeister · · Score: 2, Funny

      Well, it's been almost 18 months since this topic was last posted, so I'd venture that Slashdot has a very sophisticated article randomization algorithm!

    11. Re:And Zonk dupes himself... again... by Pahroza · · Score: 1

      Now THAT was solid gold.

    12. Re:And Zonk dupes himself... again... by mikesd81 · · Score: 2, Insightful

      Well, there is times I wanted to post an article but wasn't sure if it was posted yet and I searched for it. Surely he can too?

      --
      That which does not kill me only postpones the inevitable.
    13. Re:And Zonk dupes himself... again... by mrchaotica · · Score: 1
      but do you really expect Zonk to remember every single story he's posted

      No, but I do expect him to run a search for similar things before posting (not to mention fix Slashdot's sorry excuse for a search engine)!

      --

      "[Regarding the 'cloud,'] ownership was what made America different than Russia." -- Woz

    14. Re:And Zonk dupes himself... again... by MobileTatsu-NJG · · Score: 1

      "No, but I do expect him to run a search for similar things before posting (not to mention fix Slashdot's sorry excuse for a search engine)!

      Heh. I'm sorry, but I find this statement funny. "The search engine's horribly broken, but I still think he should search for it."

      I think everybody should purchase panties that don't bunch up so easily.

      --

      "I like to lick butts!" by MobileTatsu-NJG (#32700246) (Score:5, Informative)

    15. Re:And Zonk dupes himself... again... by mrchaotica · · Score: 1

      Stop being stupid; it's obvious that fixing the search engine would come before trying to use it!

      --

      "[Regarding the 'cloud,'] ownership was what made America different than Russia." -- Woz

    16. Re:And Zonk dupes himself... again... by MobileTatsu-NJG · · Score: 1

      And is that Zonk's job?

      --

      "I like to lick butts!" by MobileTatsu-NJG (#32700246) (Score:5, Informative)

    17. Re:And Zonk dupes himself... again... by mrchaotica · · Score: 2, Funny

      It might as well be; he's certainly not doing any editing!

      --

      "[Regarding the 'cloud,'] ownership was what made America different than Russia." -- Woz

    18. Re:And Zonk dupes himself... again... by MobileTatsu-NJG · · Score: 1

      So... it's Zonk's fault for not doing 'any editing' even though it is agreed that he doesn't have the proper tools to do it. Hehe.

      --

      "I like to lick butts!" by MobileTatsu-NJG (#32700246) (Score:5, Informative)

    19. Re:And Zonk dupes himself... again... by mrchaotica · · Score: 1

      Yes, because he's in a position where he could obtain the proper tools if he were motivated to do so. He chooses not to, so it's his fault.

      --

      "[Regarding the 'cloud,'] ownership was what made America different than Russia." -- Woz

    20. Re:And Zonk dupes himself... again... by MobileTatsu-NJG · · Score: 1

      Really? What, does he pop down to CompUSA, purchase a copy of SlashSearchPro, then arm twist one of the programmers into implementing it? Heh.

      --

      "I like to lick butts!" by MobileTatsu-NJG (#32700246) (Score:5, Informative)

  2. Bias by Anonymous Coward · · Score: 5, Informative
    1. Re:Bias by IntelEmployee · · Score: 2, Informative

      Blah Blah Blah........ Clusters are a common occurrence in randomness. If it played the same song every time you would have one extreme. If it played all the songs evenly a part, you would have the other extreme. Try something in the middle? That's where you will have clusters of a few songs played a lot, and clusters of some songs not played often or even at all. Want me draw you a picture? i iii iiiiii iii i It's all pseudo random anywho, and I don't think your clock cycle has a thing for steely dan, else the whole world is in trouble!

      --
      arette? yes please!
    2. Re:Bias by pchan- · · Score: 5, Informative

      This is exactly what is going on. Good call, AC.

      Some years ago, I worked on an mp3 playing device (no, not Apple). Our users were quite often complaining that our random was not truly random, and seems to be clustering, favoring, disliking some thing or another. Some would swear that there was some intelligence to it, picking particular songs. I've seen the shuffle code, it's a simple array swap. I ran a numerical simulation on the output and found that the distribution of the array elements from their original position equal throughout. Further, there seemed to be no specific clustering, as the probability that any item would end up next to any of its peers was again equally distributed throughout. We had some of the customers submit their own ideas and tried them out in code. In general, we found that we never outperformed the simple array swap in terms of randomness, though most results were about the same.

      The conclusion that we reached: If you have a lot of Jimmy Buffet, you're going to hear a lot of Jimmy Buffet. And on that one occassion that two Buffet songs play back to back, you're going to think to yourself "this random sucks". But it is, in fact, all in your head.

      *I'm sure someone will want to bring up the seed issue. Let's just say that we had it covered.

    3. Re:Bias by Stooshie · · Score: 2, Informative

      Just to expand on what pchan said, the chance of getting all the songs ordered by artist, is just the same as getting any other particular combination of songs.

      --
      America, Home of the Brave. ... .and the Squaw.
    4. Re:Bias by NeMon'ess · · Score: 2, Interesting

      Never-the-less, letting power-users control the randomness would be a nice feature. Say I have ten songs from an artist. When I make a playlist of a thousand songs, and the aforementioned ten all get played within the first three-hundred, that's not desirable to me. That means in the last 700 songs I'm not going to hear that artist, and that could mean weeks or months of playtime.

      Apple does include an option for the minimum number of songs before playing an artist again, but that doesn't necessarily fix the problem. The songs should be spread out. I'm okay with two of the same artist back-to-back as long as they're not all played too close together or worse, overplayed.

      Just because randomly an artist may temporarily get played more often isn't a good way of doing things.

      Additionally, iTunes and other programs don't give an option to weight the play-order based on how long it's been since a song played. If I just heard a song last week, the program should play another by that artist that I haven't heard in three months. Now I don't mean it should always play the oldest-played song first, otherwise they'd be stuck in a loop. But weight the order towards older-played.

      Finally, iTunes doesn't make a note in its database if I've skipped a song before it finished or early on. How many times have users skipped a song because he or she wasn't in the mood for it, or heard it too recently? It would be better if iTunes tracked both last-played, and last-attempted-played. So when it makes a playlist, it puts songs I haven't heard for a while in early, and songs it recently attempted-to-play in later.

      Just because what I'm asking for is 10+ times more computationally costly than what iTunes and iPods currently do doesn't mean it's hard. CPUs are more than powerful enough to do this in the background while playing songs.

    5. Re:Bias by Mattsson · · Score: 1

      The problem with most players is probably not their random-generators, but the fact that they ranomize every song-change, not keeping track of what has already been played.
      This leads to the probability of hearing one or more songs several times before all the songs in the player has been played.
      What needs doing is ranomizing a playlist and then keeping to that until all songs has been played, then randomizing a new one.
      Tadaa! No song is played twice in one pass! =)

      And, yes, there are players that do this.

      --
      /.Mattsson - My native language is not English, so please don't whine over linguistic errors. (That's lame anyway...)
    6. Re:Bias by craagz · · Score: 0

      I saw a documentary(can't recall when and where) but it dealt with a innovator who made robots that worked on solar energy. Small robots were kept in a box and only beams of sunlight allowed to specific areas of the box. The robots started fighting for that sunight filled space voluntarily. No programming except the will to survive. Maybe the mp3 player finds a way to use less battery by playing at not-so-random shuffle so that it runs longer.

    7. Re:Bias by mgblst · · Score: 1

      OK, that is fine. But that is not Random. You want something that is not Random, and that maybe the problem here. People have funny definitions of random, and random does not mean 1 of your 10 songs played every 100 songs.

    8. Re:Bias by NeMon'ess · · Score: 2, Interesting

      Right. I want a controllable Shuffled mode to mix up the order. I don't want true Random play. I think that's what a lot of people want. Perhaps even a majority.

      I don't even necessarily want 1 of those 10 songs played every 100. Last year I made a multi-thousand-song playlist in iTunes. After shuffling it and listening mostly through, I was noticing when tracks by Wolfstone played. I went back and realized that about 80% of those tracks had played in the first half of the playlist. Because the last 20% were spaced so far apart in the second half, and playing so rarely, it was catching my ear.

      So I ended up wishing the distribution had been more even. Not exactly 50-50 even, but 80-20 was too skewed. More like 65-35 would probably be enough. And of course the songs I hadn't listened-through in a long time should have been weighted to play sooner in the list than the more recently heard ones.

    9. Re:Bias by bratseth · · Score: 1, Informative

      I can't believe people really don't know this? iPods do not play (pseudo)randomly.

      They have a hard disk and a memory cache. Each time they have to spin the disk to read songs not in the cache, lots of power is consumed. To increase the battery time, the iPod will always prefer to play whatever's already in the cache.

      I'm sure they meant well when they did this, but the result is truly devastating for many use cases, because it will cause the iPod to always prefer what you have heard recently over anything else when you switch back and forth between different random selections. It is especially bad that this optimization is also in play when the iPod is running on net power. There should at least be an option to switch to true (pseudo)randomness, right now the only workaround I know is to blow the cache by letting it play random songs from the entire library over a very long period.

      To verify that this is true, try the following experiment: Play one song from an album you haven't listened to for a while, then choose to play all the songs from that album in random order. Guess which one comes first.

    10. Re:Bias by Anonymous Coward · · Score: 0

      Just FYI, those robots are analog chaotic systems. They don't have any programming, since they don't have any logic circuits.
      An mp3 player consists only of digital logic circuits. It cannot deviate from it's programming no matter how many evolutionary stimuli are applied to it.

    11. Re:Bias by Metteyya · · Score: 1

      iPod shuffle (which the article is about) does not have hard disk, it has solid-state memory.

    12. Re:Bias by GeffDE · · Score: 2, Insightful

      And I want iTunes to make me a continental breakfast every day by 7 sharp and then clean my house and prepare dinner for when I arrive home.

      iTunes is a jukebox program, not your own robotic DJ. iTunes does give the option to weight the play-order based on how long it's been since a song played. Go to your library, turn off "shuffle mode," sort the library by Date Played and play the songs you heard last. In order. There you go. 100% weighting on date played. iTunes doesn't make a note in its database if you've skipped a song because it doesn't include one of those fucking mood rings so it knows what color you are when you want to listen to Kelly Clarkson vs what color you are when you want to listen to Celine Dion. And how can iTunes tell when you heard it too recently? Maybe you just heard a new song, and like it a lot, so you want to hear it a lot. Does iTunes know that? Is iTunes supposed to have a T3 line to Ms. Cleo's brain?

      Lastly, iTunes sucks down quite a few cycles even during normal playback. And when it sucks down too many, it bogs down the system. Now, when I have iTunes on random mode, it can also be referred to as "I was iTunes to provide ambient noise for while I am working on other things." And when iTunes starts interefering with that, I get cranky. I like that iTunes does what it is supposed to do, and doesn't try to do everything. If you want something that will wipe your ass for you, find a maid, not a jukebox program.

      --
      It has been a nervous year, with people beginning to feel like Christian Scientists with appendicitis.
    13. Re:Bias by Epistax · · Score: 1

      I don't think confirmation bias is it. IDNPTIF (I do not prescribe to iPod fanboyism), but my iRiver's shuffle seems to have a problem. It may or may not be nicely random, but the issue is that it's the same random. Granted, it's several years old now, but if I load songs on there, by the third or forth cycle through on random, I can tell which song leads into what. I don't know about others, but on a CD once I play it through a couple times, I just know at the end of a song which one comes next, and my head kinda links the songs. Well with the iRiver on shuffle the same happens, and while the list appears random to be a random order, it's always the same. I could give my playlist and my shuffled playlist from my head, but I haven't used my player for anything other than an FM radio for the past 6-8 months.

    14. Re:Bias by GeffDE · · Score: 1

      The cache is 32MB, which is about 8 songs. You can blow the cache by just selecting a new set of songs to play. The iPod then says "OK Team, we need a new list of things to play," and makes a new list. It won't preferentially pick from the cache. I know that from 3 years of listening to an iPod (and accidentally getting the iPod to play my entire library on shuffle mode).

      --
      It has been a nervous year, with people beginning to feel like Christian Scientists with appendicitis.
    15. Re:Bias by Filiks · · Score: 1

      Are you saying all playback programs shouldn't be sophisticated, complete, and comprehensive? Is Photoshop a bad program for being feature-packed? Or does it get a pass for doing content-creation, instead of content-playback? ACDC is an excellent, comprehensive program for reviewing and sorting pictures. Sports Illustrated uses it. Would you say ACDC needs to pull some of those features out because they make it too usable?

      Now iTunes is obviously targeting non-power-users, but it still has some more advanced features. Why would it be so difficult or bad if it had more of them? They could even be hidden away in the menus for power-users only. Even if iTunes will never have a great shuffle mode, foobar2000 or others could, but don't yet.

      Way to go on being a snarky ass, but just sorting by Last Played won't also play highly rated songs more often, which is also desirable.

      Apparently iTunes 7 now has a Skip Count to go along with Play Count. You and the grandparent poster must not have heard. If it also now tracks the last time a track played and was skipped, that would help solve the problem now wouldn't it? Skipping a track could be interpreted as "don't play this for a while".

    16. Re:Bias by RemovableBait · · Score: 1

      Actually, this appears to be what iTunes does. Certainly for playlists.

      Try it out yourself: load up iTunes, go to a playlist and hit the 'Shuffle' button. See how the playlist randomly reorganises? If you keep hitting the button, it toggles between normal, sequential order and a different, randomly-generated, shuffle order. Guess what happens when you finish listening to the playlist (and you've got it on repeat)? Yep, iTunes reshuffles and starts again. The only chance of a song being repeated is if the song was at the end of one shuffle and the beginning of another.

      However, this is iTunes. The story is about iPods, which may handle shuffling differently.

      Disclaimer: I have not RTFA.

    17. Re:Bias by GregWebb · · Score: 2, Insightful

      Agreed. Evenly weighted (or biased according to preferences) shuffle is far more useful than random.

      In my last job, I listened to MP3s all day while working. I'd got RoboDJ feeding in the playlist, and Audioscrobbler logging the results.

      Which turned out - that, remarkably consistently, Iron Maiden, Placebo and System Of A Down (typically 'Aerials' from Toxicity) got played more than their weightings justified, while Deep Purple measurably less than theirs. Including compensating for number of tracks held.

      It may have been random, it may have been provable that each run had even distribution, but in the runs I was doing there it would have been far more useful if the computer had logged what it had already played, and tried to keep a track from getting too far outside its stated range. Less random, yes - less what I asked the computer for, definitely not.

      --

      Greg

      (Inside a nuclear plant)
      Aaaarrrggh! Run! The canary has mutated!

    18. Re:Bias by Yer+Mom · · Score: 2, Informative
      Finally, iTunes doesn't make a note in its database if I've skipped a song before it finished or early on.

      iTunes 7 does.

      Mind, it doesn't do anything particularly useful with it, but you have Last Skipped and Skip Count available for Smart Playlists, so you could probably get some way towards what you want...

      --
      Never mind Spamassassin. When's Spammerassassin coming out?
    19. Re:Bias by geoffspear · · Score: 1

      They don't. The iPod will play every song in your playlist (or your entire library, for that matter) exactly once if you leave it in shuffle mode until all songs have played. It will even display "Song X of Y" to let you know how far through the playlist it is, and reset the count when it's played everything (if you've got Repeat mode on). Of course, when the iPod is reset (or, more annoyingly, synced, at least on my 3rd generation one), it will forget where it was and play everything over again.

      --
      Don't blame me; I'm never given mod points.
    20. Re:Bias by Gr8Apes · · Score: 1

      Sounds like they're using the CD seed program. I've noticed that most CD player's random appear to be seeded by information on the CD, so they'll always play all songs in the same order, "random" be damned. Why they can't use the clock to seed it, I don't know. (If it's because they want the CD to continue playing the songs in the same order until it's finished, then save that extra information in $0.01 of flash ram and clear it on CD ejection.)

      --
      The cesspool just got a check and balance.
    21. Re:Bias by Anonymous Coward · · Score: 0

      I think it is probably one of the many bugs with iTunes (such as it's total inability to recognize Outlook or Outlook Express are installed for it's contacts function).

      There are times when iTunes shuffles 'random' playlists and each time it picks exactly the same tracks in exactly the same order. There are certain settings where 'random' literally means 'get tracks from the database, starting from record 1, in the order they appear, until the iPod is full'.

      iTunes has quite a few blatently broken (contacts, randomisation, iTunes/Quicktime player control crosstalk, audio format conversion user interface) and missing features (refreshing smart playlists, sensible format conversion context menu) so this is no surprise. It has incredibly poor quality control for something so well established. (Of course, it may be that Apple merely doesn't give a crap about quality control for the PC version).

      Admittedly, it is always the multimedia software authors who don't give a damn about standard and quality control.

    22. Re:Bias by toleraen · · Score: 1

      I seem to recall doing that exact same experiment in 4th grade, except in class we used a common bean plant. Amazingly, I received similar results.

    23. Re:Bias by Kevin+DeGraaf · · Score: 1

      I'm sure they meant well when they did this, but the result is truly devastating for many use cases, because it will cause the iPod to always prefer what you have heard recently

      Funny... when I hear "truly devastating", I tend to think of explosions, crashes, pandemics, etc. and not -- OH THE HORROR -- my iPod re-playing a song I've heard recently. Maybe it's just me.

      --
      We have more to fear from the bungling of the incompetent than from the machinations of the wicked.
    24. Re:Bias by james_orr · · Score: 1

      Which is the exact same conclusion the article came to.

    25. Re:Bias by SillyNickName4me · · Score: 1

      Why they can't use the clock to seed it, I don't know

      For modern players that should be an option, but a traditional audio cd player derives its (sample) clock from the CD..

    26. Re:Bias by TougaSempai · · Score: 1

      I'm listening to iTunes right now, and it is currently using between 0% and 1% of my CPU (which, I admit, is a 2.4 GHz Core 2 Duo, but that probably implies less than 20% usage on a single-core 500 MHz CPU). I don't think that's really "quite a few cycles," especially if your computer was built this century.

    27. Re:Bias by BytePusher · · Score: 1

      Just a thought, but it could be that we humans are remarkable good at picking out patterns... even when they don't exist. Constellations? How many of us as kids(or adults at work) can pick out pictures in ceiling tile holes? Our minds are always seeking to identify meaningful patterns. A simple game some friends and I developed is to hole up a card and have a partner guess the color, suit and then value. If they fail to guess it, put the card in another pile without showing it to your partner. I almost always find that people believe they really can know what's on the back-side of a playing card if they think hard enough. Even after failing to guess the card nearly every time, people almost always frustrated that they can't figure out the pattern.

    28. Re:Bias by hackstraw · · Score: 1

      Some years ago, I worked on an mp3 playing device (no, not Apple). Our users were quite often complaining that our random was not truly random, and seems to be clustering, favoring, disliking some thing or another. Some would swear that there was some intelligence to it, picking particular songs. I've seen the shuffle code, it's a simple array swap. I ran a numerical simulation on the output and found that the distribution of the array elements from their original position equal throughout.

      My car stereo has a "random" playback feature. The thing is that the seed is fixed either by the number of entries on the disk or by the ID of the disk or something that is constant to the disk. I get the exact same sequence of "random" songs every time I play the same disk. So, for that instance, random only means a different order than on the disk, which I guess to some people, that is random.

      Now, with the original guy's gripe. If he has 90% of his collection with Steely Dan, then 9/10 times a song is played, its going to be Steely Dan. The thing is that if he really likes steely dan, odds are he also has higher scores to the steely dan songs, and that makes the probability go beyond random as well. I've seen the odds somewhere else, but the number of stars assigned to a track does something like increase the liklihood that that song will be played X times the number of stars.

      I just got my first iPod, and havn't used it enough to tell if there are any randomness issues with it, but I have my doubts.

    29. Re:Bias by joeljkp · · Score: 1

      On the other hand, the shuffle function on my Nomad Jukebox is definitely not random. On more than one occasion, among a full 6GB of average-sized MP3s, it would backtrack across the exact same songs it played the last time it was on, in the exact reverse order. And on the order of 5 songs, not just the last 2. I'd have to clear my playlist and re-add everything to get it to randomize again.

      --
      WeRelate.org - wiki-based genealogy
    30. Re:Bias by Gr8Apes · · Score: 1

      Well, I didn't mention it, but this basically applies to every car CD player I've tested, including aftermarket systems from Pioneer, Sony, and Clarion. Every car CD player I've seen has a clock feature.

      Here's another simple algorithm that will at least provide more randomness than the current methodology, use the song in play to seed the system. For a new disk, use the last song played as the seed.

      --
      The cesspool just got a check and balance.
    31. Re:Bias by mei_mei_mei · · Score: 0

      I thought the article was all about the iPod Shuffle too!
      But it's not, it's about the shuffle feature of _all_ iPods. On the website version of the story that's linked to the picture is of Jobs holding up a shuffle, that's confusing. When I read it originally, in last Saturday's Guardian magazine, there were NO pictures of shuffles and as I read it I was thinking to myself that they were showing the wrong iPods - but they weren't because they weren't talking specifically of the Shuffle model (though that does get mentioned).

    32. Re:Bias by Mattsson · · Score: 1

      I meant that most portable mp3-players, as in ipods and other mp3-gadgets, doesn't seem to do this.

      --
      /.Mattsson - My native language is not English, so please don't whine over linguistic errors. (That's lame anyway...)
    33. Re:Bias by CreatureComfort · · Score: 2, Funny


      This is exactly the thing I try to point out to people who play the lottery and insist that their numbers are far more likely to come up than the 1 2 3 4 5 I suggest they play.

      --
      "Unheard of means only it's undreamed of yet,
      Impossible means not yet done." ~~ Julia Ecklar
    34. Re: Bias by Anonymous Coward · · Score: 0

      random != shuffle

      I hate CD players with random (panasonic) and love those with shuffle (sony).

      Hint: choice is good

    35. Re:Bias by Peganthyrus · · Score: 1

      Power users can make smart playlists to do a lot of these sorts of things.

      In fact, now that I know iTunes has a 'last skipped' filter (thanks!), I can make my 'not recently played' smart playlist actually work:

      Last Played is not in the last 5 weeks,
      Date Added is not in the last 2 weeks (because I want to avoid stuff I just got),
      Last Skipped is not in the last 5 weeks,
      Comment does not contain "difficult". (some things just don't work in general rotation...)

      --
      egypt urnash minimal art.
    36. Re:Bias by mrchaotica · · Score: 0
      The conclusion that we reached: If you have a lot of Jimmy Buffet, you're going to hear a lot of Jimmy Buffet. And on that one occassion that two Buffet songs play back to back, you're going to think to yourself "this random sucks". But it is, in fact, all in your head.

      And now here's a better conclusion: users don't actually want random. Make an algorithm that will make the probability of a song coming up inversely proportional to how recently it was last played (as well as proportional to its rating, etc.) and everyone will be happy!

      --

      "[Regarding the 'cloud,'] ownership was what made America different than Russia." -- Woz

    37. Re:Bias by yali · · Score: 1

      And don't forget the clustering illusion.

    38. Re:Bias by StikyPad · · Score: 1

      I believe I have the solution you're seeking. Using my technique, users would be able to arrange songs in an arbitrary manner according to any qualifications they desire, and then save the order of songs to something I'm temporarily calling a "playlist" until I can think of a better name. While the randomness is lost, the listener benefits by hearing only the songs he or she prefers rather than being assaulted by songs that don't fit the mood.

      But seriously, what you're asking for is to have your cake and eat it too. People want to hear the songs they want without having to pick them. There's no real solution to that since nobody else knows, or can know, what you want to hear unless you tell them. Services like Pandora.com aim to make educated guesses, but they do a half-assed job at best. The real solution is just to pick your own songs. Yeah, I know, it takes a minor amount of effort, but anything worth having does. Even if there was a device that could read your mood and try to play things accordingly, it would be a dismal failure because it wouldn't know whether to perpetuate your mood, or try to change it. Maybe you want to wallow in self-pity while listening to Wicked Game. Or maybe you want some punk rock to release the pent up frustration of it all. The bottom line is that user input is required to obtain satisfactory results.

    39. Re:Bias by Anonymous Coward · · Score: 0

      Over the last 2 months I have gone from not being in the market for a new car, to being in the market for a new car. In the last month (after establishing a short list of a few cars) I have seen so many more Golf's and C4's on the road than at any time prior. So has there been a sudden increase in the number of Golf's and C4's on the road, or beacause I am now paying attention to what I would describe as a random sample of cars, am I just noticing what has always been there?

      Oh yeah, and I assume you know about the "favour higher rated songs when shuffling" setting?

    40. Re:Bias by Anonymous Coward · · Score: 0

      That's actually what I was after (parent post AC here).

    41. Re:Bias by dfsmith · · Score: 0

      But if you're suggesting 1 2 3 4 5 to me, then the chances are that you've suggested it to someone else, and so my numbers (not yours) are likely to give me a better payoff.

      So it's not entirely unreasonable in terms of gaming reward.

    42. Re:Bias by Peeteriz · · Score: 1

      Well, the article does say that Steely Dan was 50 songs out of more than 3000, so it shouldn't repeat that often.

  3. OCD by eldavojohn · · Score: 5, Insightful
    Or - and here is the nub of an issue that would consume me for more than a year - was the shuffle function, meant to mix up my music collection in a random fashion, actually not random at all?
    There there, Mr. Levy, we'll get you all the randomness you want. In fact, we have a special place filled with randomness and padded white walls! You're going to like it there.

    You know, instead of wasting your interviewee's time, you could have installed a five song list on your iPod and set it to shuffle. You'd have to carefully mark down the track number being played and listen to it for 100 songs. Do this a few times and make sure you're very methodical about what you do. Wipe the iPod, put five songs on it in order and then listen to a hundred songs "randomly." If you start to see a pattern developing or one song is obviously favored over the other, it will begin to show up.

    But on the more technical side, they have to seed the random variable with something. Whether or not it's an internal clock, I'm not sure. Either way, they have to derive a random number and it's possible that their seed isn't good enough or has too few states or is prone to being seeded at the same state, etc. Based on this information, I hate to break it to you but it is very hard to be truly random.
    --
    My work here is dung.
    1. Re:OCD by jlarocco · · Score: 1
      But on the more technical side, they have to seed the random variable with something. Whether or not it's an internal clock, I'm not sure. Either way, they have to derive a random number and it's possible that their seed isn't good enough or has too few states or is prone to being seeded at the same state, etc. Based on this information, I hate to break it to you but it is very hard to be truly random.

      Just to be pedantic, they have to derive psuedo-random numbers. And although it is hard, there are dozens of algorithms that are "good enough" in 99.9% of cases. Like this one.

    2. Re:OCD by monoqlith · · Score: 5, Informative

      Not OCD. Sub-clinical schizophrenia. . Read all the way to the end of the article(I'm new here). If you don't want to, I'll summarize: It's more about randomness than the iPod. He eventually realizes his suspicions of programmer malfeasance are in fact an expression of his own favoritism, not the iPod's. In other words, its all in his head. So a worthwhile, interesting article, and even if he could have benefitted by experimenting himself, that wouldn't have made for a very fun read, or an interesting question to ask Steve Jobs while he had the chance.

    3. Re:OCD by ehrichweiss · · Score: 1
      Holy crap!! "It was designed to have a colossal period of 2^19937 1 (the creators of the algorithm proved this property). In practice, there is little reason to use larger ones, as most applications do not require 2^19937 unique combinations."

      To put that in decimal: 4.3154247973881626480552355163379e+6001. That's quite a number. I think that dwarfs "astronomical".

      --
      0x09F911029D74E35BD84156C5635688C0
    4. Re:OCD by timeOday · · Score: 2, Interesting
      As if any of this were relevant to music listening.

      The simple truth is that the shuffle was an extremely lame product that was only created so Apple could cover the entire price range of mp3 players. Nobody else had the gall to sell a player with no display. "An experience in aural spontaneity..." pardon me while I barf. It was a simple matter of designing to a price. I won't question Apple on it because they've made more money from the iPod than I ever would have imagined. The folks who bought a Shuffle, on the other hand, I have to wonder about.

    5. Re:OCD by hereschenes · · Score: 1

      If you actually bothered to read the article, you'd see that he covers what you've said in your last paragraph. In the end, he concludes that the perception of shuffle being non-random is nothing to do with the iPod.

      --
      More like... nerdular nerdence!
    6. Re:OCD by linuxrocks123 · · Score: 1

      I think it's more likely that people think that a random sampling should repeat less than it does. I wrote a little program called music_randomizer on my computer that plays songs randomly for me. Its main purpose is to wake me up in the morning (I have a cron job for it), but whenever I use it to just listen to songs I always find things repeating more than I expected. The code is correct; it uses the C random() function to index into an array of filenames and pick one to play, but it surely repeats a lot more than I expected it would. If I used music_randomizer frequently, I would probably add a complex weighting scheme so as to lengthen the time between songs repeating. Perhaps Apple should do the same.

      --
      vi ~/.emacs # I'm probably going to Hell for this.
    7. Re:OCD by chaoticgeek · · Score: 1

      I don't care about a display. I care about it holding my music and playing it back for me. Thats about it. I'd like some other features, like more format support but oh well. I would never buy an iPod to watch videos or play the games, I've got other things to do that. My DS works great for games and I hate the small screen to watch videos on, I'd rather have my computer or my TV do that for me.

      --
      hello
    8. Re:OCD by Crunchie+Frog · · Score: 1
      but who's counting?

      well i was but i lost my place after 43

      --
      --- Never attribute to malice that which can be adequately explained by stupidity
    9. Re:OCD by Hangin10 · · Score: 1

      This confuses me greatly. Especially in iTunes, if you set it to shuffle, then play a song, let it go to the next song and play it. Go back to the end of the first song you played, let it go to the next, and it will be the same sequence. iTunes mostly (always?) runs on computers that are almost certainly going to have a clock and a time() function linked in. On an iPod, it's perhaps more excusable; I don't remember ever setting a time on mine.

    10. Re:OCD by DrEasy · · Score: 1

      Yes, there was a lot of marketing bullshit with the launch of the Shuffle, but it wasn't a bad product at all. All it needs is a way to support multiple playlists, for example with a "skip playlist" mode or button, so that you can navigate more easily between songs. There should be no need for a display to achieve this. It is a good thing to be able to navigate songs without taking the player out of your pocket.

      --
      "In our tactical decisions, we are operating contrary to our strategic interest."
    11. Re:OCD by jawtheshark · · Score: 1

      The folks who bought a Shuffle, on the other hand, I have to wonder about.

      Cheap 1GB memory stick that also can play your music and easily enters in any USB slot, unlike the bulkier flash based MP3 players? That's why I bought one. The new Shuffle, however, doesn't have these advantages.... On the other hand, the new shuffle has the typical iPod interface and can thus be used in a car over an adapter. Not that I care, my car radio doesn't support it because my radio it is too old, even though the car is listed as "supported" *sigh*. (And yes, this is the radio that came with it out of the factory)

      --
      Ahhh...the great dumpster continuum. Many a free computer will be found there. -- sowth (748135)
    12. Re:OCD by Khuffie · · Score: 1

      From my brief experience with the iPod and iTunes player, their random features were never truly 'random'. For example, I liked David Gray's Ain't No Love so I'd usually start off with that and the iPod would be set to random. The next song would be, say, Coldplay, and the one after that would be Joshua Radin, and so on. So far, so good. Next day, I like to start with "David Gray's Ain't No Love", and sure enough, the next song would be Coldplay, followed by Joshua Radin, and so on. Until I add another song to the library or the iPod, it'd do the same order.

    13. Re:OCD by powermacx · · Score: 1
      From: http://daringfireball.net/2006/09/showtime_ipods

      Interesting side-note regarding the relative economics of Apple's music (err, "music and movies") platform: Jobs stated during his presentation that Apple had sold 10 million iPod Shuffles to date. If we say the average selling price for a Shuffle is $100 (which, if anything, might be low, considering that the original 1 GB Shuffle debuted at $149) that's about $1 billion in revenue. Jobs also stated that the iTunes Store has sold about 1.5 billion songs to date. At a buck a song, that means about $1.5 billion in revenue -- but probably less when you account for album sales, where more than 10 songs are sold for $10. Which means the iPod Shuffle alone has accounted for about the same amount of revenue (and, I'd wager, more profits) as the iTunes Store.
    14. Re:OCD by Gulthek · · Score: 1

      1) Don't need a display for audiobooks.
      2) Don't need a display when jogging to my exercise playlist
      3) Complements a fullsize iPod nicely

    15. Re:OCD by gsslay · · Score: 1
      You know, instead of wasting your interviewee's time, you could have installed a five song list on your iPod and set it to shuffle.

      You seem to be unsure of what makes a good interviewer. It's his job to ask the questions that his readers don't get a chance to. How is discussing a topic that would be of great interest to many and provide Apple an opportunity to talk up their product from an unusual angle, wasting the interviewer's time? I bet Steve Jobs loved the question, which is why he was willing to spend time chasing answers for him.

      Would it have been better to discuss iPod colours for the millionth time? I doubt Jobs would think so.

      Apart from that. Is there anything in your post that Levy himself doesn't conclude? Or didn't you bother reading that far?

    16. Re:OCD by Anonymous Coward · · Score: 0
      It's his job to ask the questions that his readers don't get a chance to. How is discussing a topic that would be of great interest to many and provide Apple an opportunity to talk up their product from an unusual angle, wasting the interviewer's time?
      How about some questions that actually matter? I don't give a fuck if the iPod is random. What about it's DRM? What about the fact that Jobs pulled 99 cents/song out of his ass? There's a million other questions that could have been asked aside from, "I don't believe your iPod is really random, can you please look into that?"

      Apart from that. Is there anything in your post that Levy himself doesn't conclude? Or didn't you bother reading that far?
      And if you had read the 3 or 4 replies prior to yours, you would have realized I've already been criticized for that. So I mentioned that it's seeded and never truly random. So what if it also appeared in a 5 page article? I really don't care. Does that invalidate the rest of my comment?
    17. Re:OCD by ketamine-bp · · Score: 1

      may or may not be subclinical huh.

    18. Re:OCD by hey! · · Score: 1

      You know, instead of wasting your interviewee's time, you could have installed a five song list on your iPod and set it to shuffle. You'd have to carefully mark down the track number being played and listen to it for 100 songs. Do this a few times and make sure you're very methodical about what you do. Wipe the iPod, put five songs on it in order and then listen to a hundred songs "randomly." If you start to see a pattern developing or one song is obviously favored over the other, it will begin to show up.

      Patterns exist in random data too, otherwise there would no no constellations in the sky.

      It is inevitable that patterns will emerge in enough random trials of anything so complex as music; it could be a "preference" for songs in a certain key, or by a certain artist, or with a certain theme in the lyrics. There being no patterns would have to be evidence, not of randomeness, but of non-randomness.

      The important issue is not the existence of patterns after a certain number of trials, but of the pattern's ability to predict future trials.

      I doubt seeding has anything to do with the patterns observed. If a pattern does persist, it would more likely be in the pseudorandom algorithm chosen. Even a really bad seeding algorithm is bound to have enough entropy to generate "random-looking" sequence when only a few thousand choices are available.

      --
      Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
    19. Re:OCD by gsslay · · Score: 1
      How about some questions that actually matter?

      I guess sometimes people want the questions that don't matter answered. Why else am I wasting my time answering this? And that's even supposing we're agreed what matters.

      What about it's DRM?

      What about it? This is an article on iPod random shuffle.

      What about the fact that Jobs pulled 99 cents/song out of his ass?

      That's not a question, that's begging the question.

      So I mentioned that it's seeded and never truly random. So what if it also appeared in a 5 page article? I really don't care. Does that invalidate the rest of my comment?

      Yup. It shows you haven't read the article and have no business commenting on it, far less criticising its content.

    20. Re:OCD by Firedog · · Score: 1

      I bought mine because it was the smallest thing out there. It's cheap to the point of being disposable, so if I crash while biking and smash it, it's no big deal. And it still holds 250 songs.

    21. Re:OCD by gauauu · · Score: 1

      Unless you get one of the smaller $20 1Gb players out there from a generic chinese brand. That's cheaper, and smaller.

    22. Re:OCD by Anonymous Coward · · Score: 0

      The seed, right, it's all about the seed........ Remember the issues with IBM XTs that had 'random' number generation issues after the CMOS batteries had gone dead? (Does that date me?)

    23. Re:OCD by greed · · Score: 1
      Nobody else had the gall to sell a player with no display.

      You entirely sure about that? Maybe nobody with a big name, but I've used CD-based MP3 players that didn't even have track number displays, let alone something that could show folder and file names--the Rio Volt was an amazing breakthrough....

      And I've got a pocket FM radio with no display. Digital synthesized tuning, and no frequency display. There's no tuning knob, all it will do is seek UP the FM band until it hits another station with sufficient signal strength. When it hits the top of the band, it wraps to the bottom and you start over.

    24. Re:OCD by Yvan256 · · Score: 1

      Apple released the iPod shuffle because most people with iPods were already listening to their music in that exact same mode: shuffle. I know that I use my 10GB iPod in shuffle 99% of the time. The other 1% is when I get new tracks (which is maybe once a month).

      The tape walkman didn't have any display. Never stopped people from using them either. The CD walkman was just barely more usable as far as displays were concerned. Telling me that "track 02" is playing doesn't help much unless I've memorized the tracks list of the CD.

      So, in short, music players don't require a display to be usable. And given the size of the new iPod shuffle, the screen would be too small to be readable anyway.

  4. SLAYER!!!!!!!1 by litewoheat · · Score: 3, Funny

    My iPod likes Slayer and Marilyn Manson. I guess its posessed.

    1. Re:SLAYER!!!!!!!1 by Reaperducer · · Score: 0, Redundant

      My iPod like Bjork and Springsteen. I think it's manic depressive.

      --
      -- I'm old enough to have lived through six different meanings of the word "hacker."
    2. Re:SLAYER!!!!!!!1 by Anonymous Coward · · Score: 0

      Possesed by a emo wannabe goth teenage fan boy?

    3. Re:SLAYER!!!!!!!1 by NeoSkandranon · · Score: 1

      Naw, it just has horrible taste ;)

      --
      If you can't see the value in jet powered ants you should turn in your nerd card. - Dunbal (464142)
  5. Never true randomness by linuxci · · Score: 1, Interesting

    Well you'll never get true randomness but I used to notice this in mp3 playing software a lot of times particularly winamp seemed to play some tracks a lot more than others when on random.

    On Linux I used to use a command line player and a nice structure of directories and symlinks to make the playlists and never used to bother with random.

    Now I do most of my work on a Mac, but I also happen to listen to music less now, so random is now random enough for me.

    Anyway, slow news day of what, this is the second pointless ipod story I read today on here :)

    I like ipods, I have one but only ever use it on long journeys and no I don't have DRM'd tracks so I didn't care about online music purchases. The ipod just happened to be the one that worked the best (scrollwheel is nice and quick) and having a mac I knew it'd work well.

    1. Re:Never true randomness by Reaperducer · · Score: 2, Insightful

      I have one but only ever use it on long journeys and no I don't have DRM'd tracks so I didn't care about online music purchases. The ipod just happened to be the one that worked the best (scrollwheel is nice and quick) and having a mac I knew it'd work well.

      It's a shame how people on Slashdot aren't allowed to just like iPods -- they always feel pressured to justify the purchase.

      "Best tool for the job" isn't good enough. You have to be different. But only in a pro-Linux anti-iPod sort of way. Any other kind of being different gets you modded troll or flamebait.

      --
      -- I'm old enough to have lived through six different meanings of the word "hacker."
    2. Re:Never true randomness by Anonymous Coward · · Score: 0

      I too have noticed that although my music is distributed across two or three folders, Winamp likes to play songs of the same artist in a row or at extremely close together. WiMP and MPClassic don't give me that problem, but I use them lots less. Before reading today, I was also conviced that it loved to stick to the same folder for quite a while, even if the selection of songs there was like 20 songs versus what must have been 90+ in another.

      It is true that patterns are in our heads. I am very tempted to mail this to my close conspiracy theorist friends, since they believe there aren't coincidences and everything is manipulated by dark lords with infinite resources throughout our complete human history. They won't say it includes iPods, but the acceptance of confirmation bias here shows me that you guys aren't so crazy after all.

    3. Re:Never true randomness by heinousjay · · Score: 1

      If I were in charge, I would declare you the winner of Slashdot.

      --
      Slashdot - where whining about luck is the new way to make the world you want.
  6. Random iPod articles? by Anonymous Coward · · Score: 0

    Probably more random than the percieved randomness of iPod articles that show up on Slashdot

  7. Mine loves Chevelle by Private.Tucker · · Score: 2, Interesting

    ...well, used to. Then I made a different playlist and labeled it as "Upbeat" music. Now It loves Motion City Soundtrack. Now, I like all the music I have on my iPod (duh) but its very noticeable when I hear the same song 3 times in one hour 30 minutes worth of driving. I can tell you that over the last 2 days (4 hours of driving) I have heard Foo Fighters' "Enough Space" 6 times out of 231 songs. Does the iPod sense higher played songs/albums/groups or is its randomness just that awful? 2GB Nano 1g

    1. Re:Mine loves Chevelle by philipgar · · Score: 2, Insightful

      if the iPod/iTunes sensed higher played songs and played them more, it would actually cause a huge disaster, depending on how it was implemented. A simple implementation would increase the likelihood that a song gets played again by a fixed percentage. Under a situation like this, no matter how small of a percentage the song increases it's likelihood of being played by, and regardless of how many songs you have on the device, over enough time it will reach the point where it will effectively only play one song over and over 99.9999999% of the time. It's the problem with positive reinforcement as the song will become more likely to be played the more it's played, and once one song gets "lucky enough" it will be promoted just high enough to start dominating, and from there it quickly runs away. I ran a simulation similar to this not too long ago as I was thinking about it.

      Now, if you scale the likelihood of a song being played by a fixed scalar value, this runaway effect won't happen, but that isn't as much fun to do, and would mean overtime the scaling would be meaningless as each song has a high enough value that the scalar/value is effectively zero (or on a floating point number could be zero).

      Phil

    2. Re:Mine loves Chevelle by merreborn · · Score: 1

      Some MP3 players just use a retarded algorithm. I had an MP3 CD player in which I stuck a CD with two folders: one with hundreds of songs, and the other with a single song. It played the single song half the time.

      That's when I realized that when in shuffle mode, the CD player first picked a random directory, and then picked a random song from in that directory -- which happens to really, really suck in the edge case I'd presented it with.

    3. Re:Mine loves Chevelle by WCLPeter · · Score: 1
      I can tell you that over the last 2 days (4 hours of driving) I have heard Foo Fighters' "Enough Space" 6 times out of 231 songs. Does the iPod sense higher played songs/albums/groups or is its randomness just that awful? 2GB Nano 1g


      I too had the same problem with my iPod (30 gig). For some reason I kept hearing some songs more than others. Eventually I just setup a Smart Playlist called "Stuff that's seldom played". It relies on the fact that when a song is fully played through it not only ups the play count but also the Last Played Date field. With the SmartPlaylist I have it set with three conditions:

      1) Last Played field does not have a date that ocurred in the last 5 days.
      2) Genre does not equal "Postcast". /* This is nice so that you don't get some half hour news-cast or something, unless you want that :-) */
      3) Time is less than 40:00. /* This relates to the length of the song. I like the mega extended versions of some songs just fine, but not while I'm driving. */

      I click the "Limit to" checkbox and set it to 250 Songs /* "items" */ selected at Random, as well as the Live Updating box so that if I don't sync my iPod for a few days it keeps adding songs currently on the iPod to the list to be played.

      You could tailor this to your 2 Gig nano by changhing the Last Played to 2 days along while setting "Limit to" for a size like 1850 MB or something that can fill the 2 gig iPod and leaving live update of the playlist on. Depending on the length of your songs, this *should* put about a day and a halfs worth of music on your iPod. Since you're unlikley to listen to it for 24 hours straight, you shouldn't run into problems with this setup.

      A nice this about this is if you have a music library larger than 2 gigs, when you sync your iPod it should automatically swap out the songs that don't meet the SmartPlaylists conditions, replacing them with ones that do.

      I've been using this setup for about a month now and the only time I hear the same song more than once every 5 days is when it's on multiple "Greatest Hits" Albums. ;-)

      Pete...
    4. Re:Mine loves Chevelle by mgblst · · Score: 1

      ...depending on how it was implemented.
       
      Yeah, I think this is really important, don't you. I hope that if they implement something like this, they actually think about it, for at least as long as you have, what do you think?

    5. Re:Mine loves Chevelle by zlogic · · Score: 1

      A truly random distribution can give you one song more than others. After all, it's random, right? So basically everything is possible, including the stuff people usually complain about. Now, if it carefully selects songs so that the same one won't play too frequently, that's not random.
      You get uniform distribution only at really large numbers, at least 10^3 or more for a two-song playlist.

    6. Re:Mine loves Chevelle by Anonymous Coward · · Score: 0

      Or they could not change things when you are playing in random mode. Afterall it's random data and should be ignored.

      PS: Yes, everyone reading your post thinks your a dumbass...

      Not realy but why not think before posting?

  8. Old News. by mh101 · · Score: 4, Informative

    I recall The Steve personally addressing this issue in one of his keynotes (although not with iPods, but iTunes). People thought iTunes' shuffle feature wasn't random enough. Steve assured everyone that it indeed was completely random, but then announced that iTunes had a new "Smart Shuffle" option. The description in iTunes is "Smart shuffle allows you to control how likely you are to hear multiple songs in a row by the same artist or from the same album." There's a slider with "More Likely" on one end, "Less likely" on the other end, and "Random" right in the middle. Although this feature is in iTunes, it has not yet made it onto iPods.

    I personally have had it happen where my iPod is in shuffle mode and I've heard not just two songs in a row by the same artist, but a song plays and then the next song from that album follows it. And that's with a library of over 5,000 songs. Naturally it's more likely to happen on a much smaller Shuffle with a fraction of the songs.

    --
    Duct tape is like the Force. It has a light side, a dark side, and it holds the universe together.
    1. Re:Old News. by the+dark+hero · · Score: 1

      I personally have had it happen where my iPod is in shuffle mode and I've heard not just two songs in a row by the same artist, but a song plays and then the next song from that album follows it. And that's with a library of over 5,000 songs. Naturally it's more likely to happen on a much smaller Shuffle with a fraction of the songs.



      I encountered a glitch once that did something quite similar, but on a more "intentional" basis. My iPod nano was in shuffle mode, but when it played the first track "Pump It," on the Black Eyed Peas album Monkey Business, it somehow managed to play the entire CD in order and then continued on it's regular shuffle. This only happened once, so it may have been a glitch or a VERY rare coincidence. Other than that, my shuffle works well enough and I only house about 900 tracks.
      --
      You constantly struggle for self improvement - and it shows.

      Hooray for bad Engrish on fortune cookies

    2. Re:Old News. by noidentity · · Score: 2

      How funny, the original shuffle was random, but that wasn't considered random because people have this odd notion that random means that certain combinations will never occur. Now they have the new, improved random that's less random so that it'll seem more random. That's progress!

    3. Re:Old News. by Purdah · · Score: 1
      This does not seem to be a problem with just IPods, my Creative Jukebox showed simmilar non randoness.

      In my case the player would, when given a playlist of any size, even over 100 tracks, would always show a preference to play two songs from the same album one after each other.

      Humans are good at spotting patterns, and if it occours to me that the two consecutive tracks from albums seems to happen frequently, then it is likely that this is indeed a flaw in the algorithm.

      Mind you as I have not done any mathematical tests, it is just as likely that because I have picked up on this anomoly, that I am only remembering when it happens and not realising how many other times it does not happen.....

    4. Re:Old News. by Neoncow · · Score: 1

      In one of my statistics classes, we performed a lab to emphasize the importance of random sampling. We were split into groups and given a set of 30 or so blocks of various shapes and sizes. we were to choose 10 blocks that were representative of the entire set. After each of the group presented their picks, the TA had a laptop randomly pick a set for every group. We added up the results. The random set was closer that the human guided guesses.

    5. Re:Old News. by Dr+Reducto · · Score: 1

      You can set iTunes to shuffle by Artist, Album, or Song.

      The problem with older versions was this wasn't wall documented (the preference was hard to find), and was set to shuffle by album by default. I know because I noticed the same thing, but eventually found out what I was doing wrong (the option was something like "Group songs by album for shuffle" or something like that)

    6. Re:Old News. by kfg · · Score: 1

      . . .people have this odd notion that random means that certain combinations will never occur.

      When in fact it means much the opposite, that given enough runs those combinations are guaranteed to occur. The whole "million monkeys" thing.

      The probability of an event that has occured is, of course, 1, but people react to it as if it had the probablity of predicting that combination.

      Probability only applies to the unknown, the whole "Schrodinger's Cat" thing. Once you know, you no longer have probability, you have data.

      KFG

    7. Re:Old News. by cpeterso · · Score: 1

      I absolutely concur. I have a Creative Zen Vision:M and its "shuffle" sucks. If I add songs to my playlist in batches (e.g. one album at a time), the Creative Zen "seems" to shuffle the new batch, but then just append it to the end of the existing, shuffled list.

    8. Re:Old News. by u38cg · · Score: 1

      This is just a variant of the Birthday Theorem at work (the idea that once you get more than twenty-something people in a room, the chances are two will share a birthday). Every pair of tracks has a possibility that you will consider them to be related, because they are the same artist, or the same song, or whatever. Given how many pairs of songs you have in your playlist, it is fairly likely that you will play closely related songs (to you) quite frequently.

      --
      [FUCK BETA]
    9. Re:Old News. by Anonymous Coward · · Score: 0

      I personally have had it happen where my iPod is in shuffle mode and I've heard not just two songs in a row by the same artist, but a song plays and then the next song from that album follows it. And that's with a library of over 5,000 songs. Naturally it's more likely to happen on a much smaller Shuffle with a fraction of the songs.

      Restate my assumptions:
        -If you graph the song order of any iPod, patterns emerge.
        Therefore, there are patterns in every iPod playlist.
        -Evidence: RTFA
        -My hypothesis: Within the iPod, there is a little deamon ...Right in front of me...hiding behind the screen.

        12:50, press Return.

      When I was a little kid, my mother told me not to stare into the sun, so when I was six I did...

    10. Re:Old News. by mei_mei_mei · · Score: 0

      "I personally have had it happen where my iPod is in shuffle mode and I've heard not just two songs in a row by the same artist, but a song plays and then the next song from that album follows it. And that's with a library of over 5,000 songs."

      5000 songs is about 500 albums each with about 10 songs. On each of those albums there are about 9 track-pairs of the kind you describe: 1->2, 2->3, ..., 9->10.

      So on your entire iPod there are about 500x9=4500 such track pairs.

      You still think it unlikely that such a pair plays occasionally?

    11. Re:Old News. by charstar · · Score: 1

      When it comes to shuffling music, random() isn't always good enough. A few years ago I wrote the playlist generator for Digital Gunfire, who plays by the record label's rules. One of these rules is "can't play a song by the same artist within N minutes of itself". So, I had to write a "guarantee'd less-likely" ordering algorithm, probably similar to the iTunes function. It's an interesting problem!

    12. Re:Old News. by daenris · · Score: 1

      Yes. Because there are roughly 2.5 million non-track pairs. So that's about .2% of the possible song pairs are track pairs like 1->2 etc. So if he listens to his entire playlist of 5000 songs, it should happen about 5 times.

      Beyond which, the OP never said he considered it unlikely. He said it happened on his iPod, and would then most likely be more likely to occur on a shuffle with a smaller capacity.

  9. Truly Random by sriramv_iyer · · Score: 4, Interesting

    I agree that it is extremly difficlut to be truly random. There are some good ways of initializing the seed in such a way that the pseudo random number generator behaves differently. A good way, done in telecom terminals is to measure the noise at the receiver and then use it to seed the random number generator. Since, the noise is truly random, that is a good way to seed the random number generator. If the costs, are not too high, then it might even be a good idea to read noise (or any truly random parameter) whenever required. That would be close to really random, provided, we can map the random parameter into a quantitative parameter without big errors and approximations.

    1. Re:Truly Random by Jerf · · Score: 2, Insightful
      It's not cost-effective to be "truly random" with an iPod Shuffle's hardware budget, but who cares. It's not at all hard to convince a pattern-seeking human that it's not "random", because our pattern-seeking human thinks "random" means "play everything once, then start over with a fresh list", which is anything but random.

      I just ran a simulation here of 100 songs, randomly chosen until all 100 songs had been selected once, and ran it 1000 times. On average, it took 523 choices to exhaust the list due to repeats, and on average, the most-played song over that time period had been played 11.7 times before the last unplayed song was finally played.

      Joe User will of course assume that the iPod "likes" the song it plays 11.7 times and "hates" the song it only "begrudgingly" gets around to playing 500+ play-throughs later, but that's true randomness.... and one of my pet peeves with MP3 programs.

      Humans very rarely want true randomness. When we claim to want randomness in our shuffle, we actually want a somewhat more sophisticated algorithm. But programmers hear "random" and, well, the easiest thing to do is just call the "randint" function... I did once write a non-random shuffler for a thoroughly-non-mainstream music program and I thought it worked out pretty well, but I've never been able to interest anyone in the idea, because it seems like a lot of implementation work vs. "randint".
      import random
      from operator import add
       
      amounts = []
      maxes = []
       
      def average(seq):
          total = reduce(add, seq) + 0.0
          return total/len(seq)
       
      for x in range(1000):
          choices = {}
       
          i = 0
          while 1:
              i += 1
              next = random.randint(0, 99)
              if not choices.has_key(next):
                  choices[next] = 1
              else:
                  choices[next] += 1
              if len(choices.keys()) == 100:
                  break
       
          amounts.append(i)
          values = choices.values()
          values.sort(lambda a, b: cmp(b, a))
          maxes.append(values[0])
       
      print "Average choices: %s" % average(amounts)
      print "Average max: %s" % average(maxes)
      Consider this program on par with any other Slashdot post; it may have typos, it may even be flat wrong, it certainly wasn't engineered for use in an enterprise-class environment nor analysed for how to make it run faster or with fewer keystrokes, etc. It wasn't composed in a browser text-box but only slightly more care was poured into it.

      As I like to say, "random is blotchy". Smoothness is a dead giveaway that a process isn't random. Randomness produces bell curves, not uniform distributions.
    2. Re:Truly Random by larytet · · Score: 1

      use kinetic - movements of the iPod to generate random seed. one gyro will do the trick

    3. Re:Truly Random by Anonymous Coward · · Score: 0

      So then whenever Im running my ipod will display certain patterns. If your going to invest in a gyro, you should have just gotten a radio receiver, upgraded to tune radio, and use white noise as your noise source.

  10. Randomness ain't so random by Anonymous Coward · · Score: 0

    So many iPod owners and none of you have stated the obvious. The iPod will play songs with a higher rating more often.

  11. Randy Random says we've seen enough by Anonymous Coward · · Score: 0, Funny

    Nonsense article again, but because it was about iPods it had to be published on the front page.

    Thank you Slashdot and all the friends here - my time among you is almost at an end. I will find another news site where I can actually read something that is worth reading. Slashdot used to be a great site, but it's nothing but shit nowadays. Bye bye!

    1. Re:Randy Random says we've seen enough by punkass · · Score: 0, Offtopic

      I should also add that I love slashdot posters who announce they're leaving...like anyone truly gives a shit. Want to make a statement about the "Slashdot establishment"? Then don't say anything and fucking go already...if you were really contributing, someone will eventually think "gee, where's that bitchy guy who couldn't be bothered to log in when he posted?" Otherwise, you're just stroking your ego in a public forum (and nobody needs to read that).

      --
      "Nobody owns the fucking words man." - James Dean
    2. Re:Randy Random says we've seen enough by Anonymous Coward · · Score: 0

      No - it's OK. I've decided to stay!

    3. Re:Randy Random says we've seen enough by __aawdrj2992 · · Score: 1

      I would like you to think about what "Anonymous Coward" means.

      As for threatening to go elsewhere- do so. Save the drama; you're not special.

    4. Re:Randy Random says we've seen enough by saboola · · Score: 1

      Every time an Anonymous Coward leaves, a cowbeal neal dies a little more inside.

    5. Re:Randy Random says we've seen enough by Anonymous Coward · · Score: 0

      No - it's OK. I've decided to stay!

      Upon further re-consideration, I'm really going to leave.

  12. People are Pattern seekers by BigDiz · · Score: 5, Insightful

    Humans innately seek patterns in things that are random. That's why so many people wear smelly socks because they think they're lucky. Once you identify a supposed "pattern" i.e. non-randomness, you're going to keep noticing instances that fit that pattern, and ignore instances that do not. This is deeply ingrained.

    Think about it, if you're at the roulette table and black has come up four times in a row, how likely are you to bet black? Most people would bet red, because, I mean hey, there's got to be a pattern. But (as I'm sure you all can understand) black has the same probability of occurring again as red does.

    People have had this complaint about all sorts of playlist randomizers (not just iPod), it's just people seeing what isn't there.

    1. Re:People are Pattern seekers by Anonymous Coward · · Score: 2, Insightful

      Exactly, if you show people two series of dots, one really random and one evenly distributed, but not regular and ask them which is more random, they will say the evenly distributed one, becasue the random one has what we see as obvious patterns in it. So, I think what people want is evenly distributed (but not regular) mixing of songs, not true randomness.

    2. Re:People are Pattern seekers by Erik+K.+Veland · · Score: 1

      Good thing you posted that, it's not like that wasn't the entire point of the article or anything.

      --
      "I tend to think of OS X as Linux with QA and Taste", James Gosling, creator of Java
    3. Re:People are Pattern seekers by lucifig · · Score: 1

      Since I got in this morning at 8est, I have heard Dust in the Wind 3 times it is now 10:22. This is out of 13.9 hours of music in that particular playlist. Not sure what kind of pattern I am seeking there.

    4. Re:People are Pattern seekers by Grishnakh · · Score: 1

      Think about it, if you're at the roulette table and black has come up four times in a row, how likely are you to bet black? Most people would bet red, because, I mean hey, there's got to be a pattern. But (as I'm sure you all can understand) black has the same probability of occurring again as red does.

      Actually, this isn't true. Roulette tables aren't truly random, because they aren't perfectly made. They've been found to be biased towards the ball landing in certain spaces. Of course, each table is unique. A google search should find lots of articles about this; a recent Slashdot article even talked about some "cheating" system someone made which predicts, fairly accurately, where the ball will land, using a timer and some other concealed equipment.

    5. Re:People are Pattern seekers by nasch · · Score: 1
      Think about it, if you're at the roulette table and black has come up four times in a row, how likely are you to bet black?
      Same probability that I would bet red: zero. :-)
  13. Two random modes by daeg · · Score: 2, Insightful

    Apple should add another random play mode -- one that acts as it does now, and the other mode that grants every song an equal play count. The only thing that would be random is which order. This way users that have a confirmation bias of their iPod favoring certain songs can no longer be paranoid of Apple conspiracies to promote the songs of {{ artist }} or {{ record_label }}.

    1. Re:Two random modes by Unequivocal · · Score: 1

      Not that it's any use for iPods, but Rockbox (http://www.rockbox.org/) MP3 (open source) OS has a random feature that (I believe this is how it works) seeds a psuedo-random number once, writes it to file, and then passes it to a two-way function that guarantees a random order but never repeats a song unless all the other songs have already been played (and since the seed is stored in a file along with the index count, it remembers where you were between power-offs - plus since it's a two way function, you can press back and get the "random" song you were just listening to.

      I still have an ancient Archos MP3 player but Rockbox is so good, I can't get rid of it and downgrade to lesser functionality. :)

    2. Re:Two random modes by ostermei · · Score: 1
      Not that it's any use for iPods
      It's not?

      You can use Rockbox on your iPod, but you'll have to make some sacrifices. For obvious reasons, DRM isn't supported, so any tracks you may have purchased from the iTMS won't play (although we all know there're ways around that). And as far as I can tell, video is not yet supported, though I can't imagine it's not being worked on.
      --
      "Outside of a dog, a book is man's best friend. Inside of a dog, it's too dark to read." -- Groucho Marx
    3. Re:Two random modes by Grishnakh · · Score: 1

      The problem I see is that what you're asking for is a "shuffle", instead of truly random play. Think of a deck of cards: shuffle a deck of cards, and deal the first card. It's an ace of spades. Now, what are the chances you'll deal another ace of spades after this? Unless the deck is rigged, it's zero. You'd have to deal the rest of the deck (51 cards) and then reshuffle before you'll see that same card again.

      The problem with random play, I think, is that after a song is played, the player picks another random song, and that same song has the same chance of getting played as any other song. Sure, that's random, but no one really wants that. People don't want "random play", they want "songs played in a random order without repeating before the next shuffle", or we could borrow the term from cards and just call it "shuffle play".

      Now, if the Apple Shuffle isn't actually doing a "shuffle play" instead of a truly "random play", then I say Apple is guilty of false advertising.

    4. Re:Two random modes by Junior+J.+Junior+III · · Score: 1

      Better still would be a weighted random shuffle that generated equal play count, but weighted by how many stars you assigned a song, and which you could adjust on the fly to suit your tastes at the moment.

      --
      You see? You see? Your stupid minds! Stupid! Stupid!
  14. I've got an iPod Shuffle, myself by Thisfox · · Score: 1

    ...it's good to listen to on the train, you get all sorts of random songs, sort of like your own personal radio station... so long as you like the Beatles, that is. I punished the little unit by removing all the Beatles songs currently on it (there were 5, out of a full gig worth of songs) and instead of every second song being Norwegian Wood (for five hours I got random song, Beatles, random song, Beatles, random song, Beatles...), it started acting more normally.

    Recent re-introduction of more Beatles music last week hasn't caused a return to the 60s, either, to my surprise. Yet.
    I have noticed a lot more Beethoven than I thought I owned though....

    1. Re:I've got an iPod Shuffle, myself by mjwx · · Score: 0

      The Ipod shuffle is not random, rather playing from a pre-set play list that is created by craptunes when you plug it into a computer.

      Its for this reason and the lack of a screen (mainly because of the lack of a screen) that I bought a Creative Zen and haven't looked back.

      Now I am planing to dupe some apple fan into "paying for the design" of my old ipod shuffle.

      --
      Calling someone a "hater" only means you can not rationally rebut their argument.
    2. Re:I've got an iPod Shuffle, myself by Thisfox · · Score: 1

      Ah, but you see, I got a 3 year warranty, and a plug and play system I didn't need to learn how to use.
      I'm happy.
      It's the philosophy of the user which is the key to the iPod: I don't expect anything but a random storage device for my resume and a simple way of having a pocket full of music. It does what I expected, no more, and I get to play with the playlist as a bonus.

      And seeing as it's survived a trip through the washing machine with no ill effects, I'm happy with my purchase. I'd like to see a no name mp3 player do that!

  15. Scientific study? by deopmix · · Score: 1

    What I want to see is someone who actually scientifically tests the randomness of the suffle. Perhaps you could use Autofill a couple hundred times, and test it to see if all the songs are chosen equally.

    1. Re:Scientific study? by necro2607 · · Score: 1

      Ok, that's not really random though. That's just shuffling everything around and actually applying some logistical algorithms on the music - somethign like "mix up the songs so no two songs by the same band play in succession, and don't play any song more than once".

  16. Re:Bias - hmm by sreekotay · · Score: 3, Insightful

    Not sure its so much confirmation bias (alone at least), as it is that the odds of NOT playing a song from the same artists over the next X songs shrinks more rapidly than intuition suggests. That is, for example the odds of NOT having a run of X heads or Y tails when flipping Z coins is very, very small.

    The article mentions the "how many people does it take to get to a shared birthday thing" - and the point there is that its not that it takes 40 people to get to one with a SPECIFIC birthday but only 40 or so to find two that SHARE a birthday.
    -----
    graphically speaking

  17. SmartShuffle by RzUpAnmsCwrds · · Score: 3, Interesting

    The open-source music player I wrote (BSoftPlayer) has a feature called "SmartShuffle". One of the biggest problems with shuffle is that it's difficult to understand when the tracks will change order, and it's difficult to know wheter or not a track is going to be played more than once in a single "cycle". Some shuffle features will play the same track twice before playing through your entire library, and some won't.

    With SmartShuffle, the order is randomized, but it remains the same until you "reshuffle".

    1. Re:SmartShuffle by SanityInAnarchy · · Score: 1

      iTunes/iPod already does this, and it is, indeed, what "shuffle" means -- so long as you pause (instead of stopping or turning it off), you're still playing through a randomized playlist. The problem is spookiness of seeing five songs by the same artist in a row, or very close together, in that random playlist, but that's statistically likely anyway.

      You might consider calling it something else. Apple is calling their new shuffle feature "SmartShuffle", but in this case, it's about creating a bias against playing songs by the same artist or album too close together.

      --
      Don't thank God, thank a doctor!
    2. Re:SmartShuffle by Anonymous Coward · · Score: 0

      the iPod also seems to reset that random order every time you sync plug it into your computer. So I often seem to be hearing the same songs every morning because the iPod has "forgotten" that it already played those songs yesterday.

    3. Re:SmartShuffle by mibus · · Score: 1

      With SmartShuffle, the order is randomized, but it remains the same until you "reshuffle".

      Is it different from the way XMMS et al. create their shuffle lists?

    4. Re: SmartShuffle by Anonymous Coward · · Score: 0

      Uh, it isn't "SmartShuffle" it is "Shuffle". "Random" would be something you could add but as I've tried to point out on this discussion, random != shuffle.

  18. Whoa... by PresidentEnder · · Score: 1
    But on the more technical side, they have to seed the random variable with something. Whether or not it's an internal clock, I'm not sure. Either way, they have to derive a random number and it's possible that their seed isn't good enough or has too few states or is prone to being seeded at the same state, etc. Based on this information, I hate to break it to you but it is very hard to be truly random.

    There must be bias on the internet. I remember reading the same thing not ten minutes ago in TFA... creepy.

    --
    I used to carry a bottle of whiskey for snake bite. And two snakes. -Nefarious Wheel
    1. Re:Whoa... by cp.tar · · Score: 1
      There must be bias on the internet.

      You mean... no net neutrality?

      --
      Ignore this signature. By order.
  19. Truly, a Slashdot legend by punkass · · Score: 4, Funny

    What, we're losing Anonymous Coward? He's been here since the begining, and he wrote half the posts! OH NOES!!!!1!

    --
    "Nobody owns the fucking words man." - James Dean
    1. Re:Truly, a Slashdot legend by Anonymous Coward · · Score: 1, Funny

      There are actually three of us writing AC posts, and even if Larry quits, Taco usually finds new hires off the street pretty quick. The pay is lousy but the OSDL guys are a lot better bosses than my pimp ever was. The GNAA people have it a lot worse, so I can't really complain.

  20. It's because of the birthday paradox by neomage86 · · Score: 3, Informative

    You can get the technical details here: http://en.wikipedia.org/wiki/Birthday_paradox/


    The basic gist is that their are far more possible pairs than we'd intuitively imagine. For example, with 20 albums of 20 songs each, the chance of two songs in a row being from the same album is actually:
    400/400 * 20/400 = 1/20
    Which makes a lot of sense once you sit down and think about it, but is a lot higher than an uneducated guess.

    This is the same reason that collision/timing attacks are feasible.

    1. Re:It's because of the birthday paradox by mh101 · · Score: 1

      There are 12 people on staff where I work. 4 of us have birthdays in a span of 5 days, i.e. there's my birthday, one day off, then three birthdays in a row. I wonder what the odds of this happening are.

      The downside of all this is we get gypped out of 3 birthday cakes this way since we only have one for all four of us. :(

      --
      Duct tape is like the Force. It has a light side, a dark side, and it holds the universe together.
    2. Re:It's because of the birthday paradox by nine-times · · Score: 3, Funny

      I think it's more than that. Yes, coincidences will happen, but I also think part of the issue with people perceiving patterns is that they can switch patterns whenever a new pattern seems to emerge. So, with reference to the Birthday Paradox, it's true that, in a party, it's more likely than you think that two people will have the same birthday, but what if you aren't bound by birthdays? What if you're just constantly looking for anything two people could have in common? If you're at the party constantly talking about dates, birthdays, anniversaries, favorite colors, food alergies, etc.-- then there's an excellent chance that you'll find there are lots of people in the party that something in common.

      In the case of the iPod, i have an iPod and put it on shuffle often enough. For a little while, i'd always be suspicious that there was something going on. It seemed to happen way too often that I'd get two songs together off the same album or the same band, or I'd get a bunch of '80s songs together, or a lot of songs that I'd grouped in the same genre. You know, no specific pattern I could use to predict what would come next, but on any given day, I seemed to be able to find a pattern.

      It wasn't always very conscious or thought out, but I'd catch myself thinking, "weird, I've heard 4 songs from the same album in the last hour. The iPod must not be mixing it up enough." But then I noticed some of my patterns were like, "huh, I've heard a couple Nirvana songs and Foo Fighter songs. My iPod must like Dave Grohl today." And then I realized, I didn't have the name "Dave Grohl" in any metadata anywhere. In order for the pattern to be caused by the library, you'd have to assume that the iPod's circutry somehow knew that Grohl was in both of those bands, but without any such link existing in my iTunes library.

      So of course I got rid of the iPod, because it was obviously possessed by the devil and obessesed with Dave Grohl. I guess this guy is right.

    3. Re:It's because of the birthday paradox by Rufus211 · · Score: 1

      Nitpick, the probability is: 1 * 19/399 ~= 1/20. The simple explenation is you pick any song, and then there are 19 songs from the same CD out of the remaining 399 songs.

    4. Re:It's because of the birthday paradox by taustin · · Score: 1

      Whatever the odds are, they aren't so high that it isn't inevitable that somehwere, there is an office with 12 people, five of whom have birthdays next to each other. It has to happen somewhere; you just happen to be it.

  21. RTFA by mh101 · · Score: 4, Informative
    The article actually goes into more depth than people seem to be getting from the summary. The author is not complaining about problems with the shuffle. Rather, he starts by making note of his early observations, then describing his research into music shuffling, and how we perceive patterns where there are none.

    FTFA:
    First of all, note what it doesn't do - it's not like mixing all the songs in the equivalent of a big bucket of lottery balls and picking out the next one. Instead, as the name implies, it shuffles the entire library so as to reorder them, just as a blackjack dealer shuffles a deck of cards. If you listen to the entire library all through, you will hear every song once and once only. What is important, then, is not whether a song is included but how evenly an artist's songs are distributed throughout the list. When I say that Steely Dan is over-represented, it means that the band's songs show up early in the run - it would be like a blackjack dealer whose first hand had aces in it.
    Or
    We perceive trends when there are none. Poker players invariably believe they can lock into streaks. Backgammon champions swear that dice can go hot or cold. Likewise, people think they can cosmically predict what song will come next on their shuffle. The blogger Kapgar, who claimed this power, remembers vividly the times when he predicted a song and the iPod amazingly delivered it. But there may have been a thousand times when his iPod played songs he didn't guess - non-memorable circumstances that, not surprisingly, didn't make an impression.
    --
    Duct tape is like the Force. It has a light side, a dark side, and it holds the universe together.
    1. Re:RTFA by Filiks · · Score: 1

      Does it though? This guy just found that to play all 100 songs once took an average of 523 total plays. By that time the most-played song had played 11.3 times.

      So if all Smart Shuffle does is prevent two songs from the same artist or album from playing too closely, it still might not even out the play count. It might mean that some songs still play three times in a list while some songs only play once. It's not good enough that over time they can average out, because users likely want consistently more-even play counts.

    2. Re:RTFA by SanityInAnarchy · · Score: 1

      I don't know if Smart Shuffle is the default, and that guy makes no mention of it. And shuffle had already prevented the same songs from playing three times in a list -- the problem is there might be some trigger (plugging your iPod into a computer, for instance) that reshuffles the list.

      Personally, I'm fine with the original randomness, which I still use on my desktop (though not with iTunes). If I really want to, I can generate random playlists and stick to those, but I don't care enough.

      --
      Don't thank God, thank a doctor!
    3. Re:RTFA by conigs · · Score: 1

      Slashdot: where repeating an article in a post is "+5 Insightful"
      Apparently my sig is almost true.

      --
      Slashdot: where repeating an article in a post is "+5 Insightful"
  22. Sorry buddy, i disagree by TheCouchPotatoFamine · · Score: 2, Interesting

    I think (and have... thunk?) that "randomness" on the ipod is actually a secret R&D weapon in the apple ipod toolkit. From a psychological standpoint alone, what is the value of all other mp3 players being truly (read unadjusted psuedo random) and the ipod being a little less.. that is, what if they, say, mark the number of times you don't let a song play through, but skip it in the first 10 seconds? There are powerful means by which they can onboard build a profile and i have three things to say about that:

    1) that is a FUN project for a team of engineers to do and,
    2) Why wouldn't they for the HUGE hidden psycological impact it could have in differentiating the player
    3) It's closed source so you can't actually tell, so the five songs with-no-user-input model wouldn't work. Another might...

    Regardless, i wouldn't expect them to miss the importance such a feature would have. The iPod just keeps the vibe going, while the competition keeps playing country-house-ambient-country-house-ambient

    Also, the "sound-check" would be a good place to do some quick BPM detection to have like tempo's play. The new settings for more- or less-random in iTunes almost scream "we are doing something tricky"

    Wouldn't you, if you could?

    --
    CS majors know the time/space tradeoff, but they never get taught the 3rd, crucial, tradeoff of the set: comprehension!
  23. What you should expect... by YGingras · · Score: 4, Interesting

    A long time ago I was dissatisfied by the lack of random in XMMS so I jumped to the source to see what I could do. I think this was my first contribution to a free software project. Anyway, here is what I found: XMMS keeps two copies of the playlist, one that is in the order you set and one that is "shuffled". This has to be clear, all the tracks in the play list are there exactly once in the shuffled playlist.

    I can't recall when the shuffled playlist was reshuffled but in was not that often, maybe only when you added or removed tracks. So if you like Smoke on Water but that Ballroom Blitz is just two song after that, too bad, you'll always get Ballroom Blitz soon after you double click on Smoke on Water. Technically speaking, the shuffling was perfect, the random generator was properly seeded and they divided in the right way to prevent loosing entropy. The lack of reshuffling was entirely responsible to the perceived lack of randomness.

    So my patch was just that: trigger reshuffling a lot more often. As far as I know this patch was never merged but my copy of XMMS did have the proper random behavior. I don't know if it's the same problem with the iPod. That's something I like with free software: you can fix it!

    1. Re:What you should expect... by NeoSkandranon · · Score: 1

      iTunes seems to have the same behavior, and as far as i can tell, only reshuffles once a session. That becomes pretty obvious in a short playlist, when a song's likely to be repeated, or when you go "oh hey i want to listen to that Krokus tune again" and the same song always comes after it.

      Reshuffling whenever you manually select a song seems like a good solution to me.

      --
      If you can't see the value in jet powered ants you should turn in your nerd card. - Dunbal (464142)
    2. Re:What you should expect... by Tony+Hoyle · · Score: 1

      I've been trying to work out what my car stereo does. It interfaces directly with the ipod and has its own shuffle mode, however it's not done as you describe as far as I can tell.

      Basically what happens is if you listen to a track all the way through it gets marked that you 'like' that track (I think the ipod itself records this data as itunes can see it as last played/number of plays). What the stereo seems to be doing is giving higher weighting to tracks, artists (or possibly genres but they're harder to pin down) that you 'like'.

      What will happen is that in a 30 minutes journey you'll get the same artist multiple times - in fact even the same song... and this is nearly always a song that you've listened to all the way through in 'random' previously. This also seems to work in genres.

      I've been able to 'fix' the shuffle mode by listening to a series of tracks by an artist all the way through and hitting 'random' - that artist then appears multiple times within the first hour.

      All this would be great... after all what you want it the ipod playing tracks you like all the time... however it causes it to miss out on the less known stuff, which comes up very rarely - and becomes a self reinforcing problem. At the moment it tends to choose from less than 100 songs repeatedly (from a library of about 5000 songs).

      I wonder if there's a way to delete the last played data from itunes and see if it becomes more random.

    3. Re: What you should expect... by Anonymous Coward · · Score: 0

      random != shuffle

      DO NOT mix those 2 words up, you contribute to the problem when you do.

      BTW, resubmit the patch.

  24. Netgear MP101 randomness by M0b1u5 · · Score: 1

    I wonder if the "random" on an iPod is like the "random" on my Netgear MP101 wireless audio device connected to my stereo system.

    If I select any playlist, and hit "PLAY" when the shuffle option is set to "Random" - then it plays the same order of songs every single time. To get a genuinely "more random" feel to the way it plays songs, I have to select the non-first song at the start of the playlist, then hit PLAY - and then hit "NEXT". After *that* it seems to be relatively random (Except for a pre-disposition to playing Eminem - or so it seems!).

    I know it's tough to generate truly random numbers - but lets face it - for a music player - random doesn't need to be "truly random" - merely random enough to avoid getting posted at /. about not being random. :P

    --
    How many escape pods are there? "NONE,SIR!" You counted them? "TWICE, SIR!"
    1. Re:Netgear MP101 randomness by maglor_83 · · Score: 1

      I hate the random on my car's MP3 player. It doesn't keep any memory of what has been played or anything, so you sometimes get the same song twice in a row, but thats no problem. What sucks is that if you skip a song, it doesn't go to a new, random song, it goes to the next song in order! So if I don't feel like listening to Ben Harper at the moment, I have to either skip every song of his on the CD, or turn random off then on again.

  25. Check the play count by Lumpish+Scholar · · Score: 2, Informative
    I didn't keep track of every song that played every time I shuffled my tunes....
    Yeah, you did; or rather, iTunes kept track for you, as the "play count". Take a look.

    (I looked at mine; it was closer to uniform than I'd perceived. There's also a "Skip Count", but it's blank for all my songs.)

    --
    Stupid job ads, weird spam, occasional insight at
    1. Re:Check the play count by Phroggy · · Score: 1

      Skip Count is new in iTunes 7, which is why it's blank for songs you've only skipped prior to upgrading.

      --
      $x='S24;r)>63/* h@<5+oZ)32"5cz';$me='phroggy'x$];
      $x=~y+ -xz+\0-Tx+;print$_^chop$me for split'',$x;
    2. Re:Check the play count by supertsaar · · Score: 1

      Dangerously Drifting Offtopic, _and_ this is probably not the place to ask, but anyway: Do iPods support this?
      Mine is a 10 gig 2nd gen (although I had to replace the battery it still works like a dream, I love it to death and will not replace it untill it breaks)
      I'm pretty sure I've skipped songs (I always do) but no skips seem to have been counted.
      Too bad, because that's one thing I would really appriciate (I'd get rid of the stuff I keep skipping, with 10 gigs you have to be picky). But hey, I managed without it for nearly 4 years now...

      --
      The Bigger The Headache The Bigger the Pill
    3. Re:Check the play count by Phroggy · · Score: 1

      Probably not yet, but since iTunes supports the metadata now, perhaps in the future, iPods will support it. It could be introduced on existing iPods with a firmware update, or it could be a new feature only available on new iPods that haven't been released yet.

      --
      $x='S24;r)>63/* h@<5+oZ)32"5cz';$me='phroggy'x$];
      $x=~y+ -xz+\0-Tx+;print$_^chop$me for split'',$x;
  26. Well, my iPod has GPS by bedouin · · Score: 1

    Because it seems the same songs play at certain points that I drive through in the city.

    Or maybe it's not a grand conspiracy at all, but this grand idea called chance.

  27. My Shuffle Experiance by Jarjarthejedi · · Score: 1

    I got myself a shuffle a couple months ago and put a bunch of songs on it, played it almost every day, at least once a day, sometimes more, for almost 2 months...never noticed a single bias of any kind (other than a small bias towards playing newer songs if you turn it on in shuffle mode). However, I ran my songs through a couple filters to remove all traces of information that I didn't put in (I.E. Ingrained bands, other data apple might put in songs from the ITunes library) so perhaps the shuffle uses a psedu-random generator, weighed towards ITunes songs or something. Or, as someone said earlier, perhaps it's just your perception. If you have 5 songs from a certain band, and 130 songs you'd think it would be 65 songs between them, but that's not even close to true. In a full random generator you'd get bursts of lots of a certain band, followed by breaks between that band's songs. So it would seem like there was very little time between that band's songs, when really you're just forgetting the times that you didn't hear that band for a long time. Or maybe Apple is out to force you to listen to certain bands, 'cause you know they make a penny every time you hear the song...*end sarcasm*...seriously though, what would make Apple program the shuffle to favor certain bands? Maybe some money from those bands, but it would have to be a good amount, and who wants to pay to make sure you listen to them a lot, they don't make money when you hear them either. No one stands to benefit from forcing you to listen to the same band a hundred times so why would they go out of their way to add that to the programming? As a new programmer I'm 99% sure it's harder to program a random generator that's intentionally weighed over one that's not.

    --
    There are two kinds of fool One says 'This is old therefore good' Another says 'This is new therefore better'- Dean Ing
  28. I've experienced the same by hbmartin · · Score: 0, Redundant

    My old iPod LOVED Moby.

    --
    Karma: Bizzare (mostly affected by varying internal caffeine levels.)
  29. Sony CD Players by mssymrvn · · Score: 1

    Well, the random is better than Sony's original implementation of 'shuffle' for its CD players. I think it's better now in new players but I used to be able to put in a disc in old players (1993 and earlier) and the track ordering was the same for *every* disc. Eject disc A and put it back in to be played in 'shuffle'? Same order over and over. It was really quite annoying. Disc B? Same 'shuffled' track order. That's quite some effort they put into that algorithm.

    1. Re:Sony CD Players by Anonymous Coward · · Score: 0

      My guess would be they didn't seed their random number generator.

    2. Re:Sony CD Players by toddestan · · Score: 1

      I had an Aiwa CD player that seemed to pull something off of the CD for it's seed. Which meant that while it was more random than the Sony one, the same CD would always get played in the same random order everytime. They should have used something like the amount of time the CD player had been on in milliseconds or something instead (the CD player didn't have a clock, so you couldn't use the time/date).

  30. My own experience by elliott666 · · Score: 1

    I always found that the pattern of "random" on the ipod was pretty easy to pick out. It seems to only like a certain set of music; some stuff gets played all the time while some things never seem to get picked. The interesting thing is that when you put more music on there and seems to bump the whole shuffle order around, so things that were never coming up before all of a sudden start getting picked.

    I wonder what it would take get something like amarok to bump the files around? Maybe a simple function to remove 10 "random" albums and then re-add them would be all that's needed to get a much better shuffle.

  31. Human brains hardwired for temporal connections. by Vellmont · · Score: 1

    Is it possible that human brains just have the gain set a bit higher than simply "random" on connecting temporal causal events? It might be more adventageous to notice connections between events that aren't connected (then dissmiss them) than it is to ignore events that are connected causally.

    In other words, it might be better to be a little over paranoid and think that the random shuffle on an Ipod isn't random, that childhood vaccinations cause (insert disease here) than it is to miss the fact that when some people eat fruit A, they die (but not say everyone).

    Putting it a bit differently, there's more cost to missing connecting certain dangerous events than there is to miss-identifying harmless events that later turn out to be non-connected.

    --
    AccountKiller
  32. ASDAT by Gerr · · Score: 0

    What is wrong with an iPod that plays nothing but Steely Dan? I'd buy one if Apple made it.

    All Steely Dan, All the Time

    There's far worse iTunes/iPod problems to complain about. How about their choices with DRM, difficulties with moving your iPod from one computer (home) to another (work)? Add a third (laptop at home) and then what?

    1. Re:ASDAT by Randle_Revar · · Score: 1

      What is wrong with an iPod that plays nothing but Steely Dan?

      That's what I was thinking :-)

      Last.fm - top artists:
      Steely Dan - 13654
      They Might be Giants - 4493
      Donald Fagen - 3532

  33. How about iPod Tetris' randomness? by mh101 · · Score: 1

    Music shuffling is fine. What needs to be fixed is the randomness of the blocks in the iPod version of Tetris. Without fail, it always starts me out with the red "Z" block, yellow square, red "Z" and the brown "L" block for the first game upon starting Tetris (after this the next game starts with different blocks, unless I quit and reload Tetris).

    Seems to me like the programmers used a bad choice of a seed value for the random number generator.

    --
    Duct tape is like the Force. It has a light side, a dark side, and it holds the universe together.
  34. Uniform randomness by FortranDragon · · Score: 1

    I noticed that most people view a uniform distribution as a "random" distribution. As the article states, people impose patterns on things, thus when the average person tries to makes something random they tend to create something with a uniform distribution 'because it spreads the stuff out'. Ah, the fun of counter-intuitive math. :D

    --
    "All the darkness in the world can not quench the light of one small candle."
  35. RTFA by SanityInAnarchy · · Score: 1

    This is just about exactly what "Smart Shuffle" does. It allows you to bias the randomness towards not playing two songs from the same artist or album in a row. Makes it less random to make it feel more random.

    --
    Don't thank God, thank a doctor!
  36. Similar to radio stations by dodongo · · Score: 4, Informative

    I know there will be snarky +5 Funny comments underneath this (as well there should be), but this system to decrease the perceived randomness is actually really similar to the algorithm most radio stations use when programming their music.

    There's a simple parameter that's set to control, to within one minute, the amount of temporal separation there must be between playing two songs from the same artist, or the same song twice. The radio algorithm is a little more complicated, since songs aren't in just one big batch like the iTunes library, but in different categories, based generally on the perceived desire of target listeners to hear a given new song, or like and identify with a given older song.

    The system is built off the (once literal, now metaphorical) use of index cards: The format clocks say, e.g., at the top of the hour, play a P category song, followed by a B category song, then a G, then an A, etc. You'd have a set of rules, like "don't play the same artist within 45 minutes" or "don't play the same current song within 3 hours", and you'd take the first card in the category that fit all the rules, play it, and move the card to the back of the stack.

    Basically, what Apple is doing with that slider is enabling artist separation control, which is completely one of the illusions radio stations (used to) use to convince you they had every song under the sun available to them.

    1. Re:Similar to radio stations by feyhunde · · Score: 1

      What is this thing called Radio? Is it like podcasting?

      --
      I'd say more, but my guild is raiding.
    2. Re:Similar to radio stations by dodongo · · Score: 1

      It's like podcasting on a massive wireless scale. Except you have almost no choice of content by comparison, and the radio hosts get paid even less.

    3. Re:Similar to radio stations by Anonymous Coward · · Score: 0

      similar to the algorithm most radio stations use

      Okay, maybe I'm out of it because I haven't done any radio station programming for over 20 years, but I wonder if there is a single algorithm that most radio stations use. I wrote a radio station music scheduler in the early 80s. Mine was written to encode the exisiting rules of my client station (KYSR) and couldn't be changed. Had I kept on developing the product, the next version would have been customizable by the client and could be used for any radio station. The main problem for me was the existence of a well-funded company doing exactly that - Jefferson Pilot.

      Anyway, before computers were used to schedule music, radio station music directors had some programming rules that they gave to the DJs. Rules like no back-to-back female artists, or back-to-back R&B artists (unless you were actually an R&B station - you didn't want to sound too black!). Each station or music director had their own programming rules. The hot 20 songs were kept in a cardboard box on the console desk, 45s or carts in my day boys and girls. When it came time to play a song from the hot 20 category (about 4 times an hour in drive time) you reached into the box and picked the song in front. When finished, you'd place it in the back of the box. You were allowed to slightly deviate from the font-to-back rule in certain situations eg 2.:47 minutes remaining until top-of-the-hour network news and the front song is 3:30 but the next song is 2:35. So, you'd run the through the hot 20 in about 5 hours. In other ways the rules were very flexible. For example, when it was time to play a golden oldie you could play any golden oldie you wanted, but only once per shift. Before music logs, you didn't know what the previous DJ had played on his shift. The computers changed all that, making the mix and therefore the sound of the station more uniform across the day or shifts. And they made BMI/ASCAP audits a breeze!

  37. Me too, me too by 1310nm · · Score: 0, Redundant

    I've noticed it too. There are songs in my MP3 collection that I'm not very fond of that I hear quite a bit of, and many that I like that I never hear on shuffle.

  38. Re:No No No! by SanityInAnarchy · · Score: 1

    No, it's not! You have "al" four times in that, at least! Do you have something against Al! OMG CONSPIRACY!!!

    The point is that true randomness doesn't look random, because randomness necessarily includes the possibility of patterns.

    --
    Don't thank God, thank a doctor!
  39. Hello World by Anonymous Coward · · Score: 0

    Got on Vans but they look like sneakers!!!

  40. I'm sure it's better than a Creative Nomad Jukebox by musther · · Score: 1
    I used to have a Creative Nomad Jukebox, although it was called a DAP (Digital Audio Player) outside the US. One of their original hard drive MP3 players. It had the play modes you'd expect, including random and shuffle. Random and shuffle did exactly the same thing, which was to play some songs all the time, and I mean all the time, some tracks from time to time, and some tracks never. In recent years I put it in the car, and occasionally in a 20-30 minute journey I would hear the same song two or three times, I had about 1000 tracks on it.

    It seemed to get worse as it got older, I even wiped it, took out the hard drive and trashed the partition table on a pc, then rebuilt it and started again, but it didn't change a thing.

    Thank god it's now in lots of little bits!

  41. Grouping songs by edwardpickman · · Score: 1

    I don't have an iPod but iTunes does tend to group songs by the artist. It's not consistent but easily half the time there will be groupings of songs by a given artist. For some reason the last time it shuffled it grouped all the songs by artist. I'd say it was set to a mode that does that but it's not consistent. It can't be random chance either because it happens too often. If I have two songs by a given artist roughly half the time it'll group those songs together. Odd thing. I'd like it to be much more random. Love the service but it is quirky.

  42. xmms experiment by jesterzog · · Score: 1

    As far as I know this patch was never merged but my copy of XMMS did have the proper random behavior.

    For what it's worth, I've just experimented with XMMS (1.2.10) in random mode, and it seems to be doing this now.

    If I double-click a track to play it, then click advance, it was always advancing to a different track, implying that it reshuffled at the point of selecting a track. Simply moving backwards and forwards between tracks left them in a consistent order, however.

    1. Re:xmms experiment by The+Blue+Meanie · · Score: 1
      If I double-click a track to play it, then click advance, it was always advancing to a different track, implying that it reshuffled at the point of selecting a track. Simply moving backwards and forwards between tracks left them in a consistent order, however.

      That's been my experience as well (the "random" playback order is consistent until you manually choose a track).

      In the spirit of the article, regarding noticing patterns where there really aren't any, it's been my perception with XMMS that it tends to pick "pairs" of songs. That is, for any given track it plays at random, the chance of the next "random" track being from the same artist seems to be significantly higher. I have an XMMS playlist of over 2000 tracks, with literally hundreds of artists, and yet when a track from any particular artist plays, the next track is also from that artist far more often than not. I've often wondered if the particular random algorithm that was chosen for XMMS doesn't have a preference for two numbers close to each other, then farther apart, etc. since I generally keep my playlist sorted by artist.

      --
      "I feel that if a person can't communicate, the very least he can do is to shut up." -- Tom Lehrer
    2. Re:xmms experiment by YGingras · · Score: 1

      Bug 21 in the XMMS Bugzilla, it was fixed in November 2002 by Håvard Kvålen. Not my patch but the general idea was kept. Ain't it a nice world we live in?

    3. Re:xmms experiment by YGingras · · Score: 1
      In the spirit of the article, regarding noticing patterns where there really aren't any, it's been my perception with XMMS that it tends to pick "pairs" of songs. That is, for any given track it plays at random, the chance of the next "random" track being from the same artist seems to be significantly higher.
      Lets use the same logic as the birthday paradox. Suppose you have two albums of each artists, with 15 songs per albums. The probability that an artist don't have consecutive songs is

          2000/2000 * 1998/2000 * 1996/2000 * ... * 1942/2000 = 0.644
          = reduce(lambda x, y:x*y, [x/2000.0 for x in range(1942, 2002, 2)])

      That is, we have to skip a place on the playlist. You'll admit that this probability is kind of low, now you have to combine all your artists. With 2000 and 30 songs per artists you have 67 artists. The probability that non of them has consecutive songs is 0.664^67= 0.000000000000164.

      To sum up, it is almost impossible not to have twice the same artist for all the artists and you should expect 36% of the artists to have consecutive songs. XMMS shuffle the list properly, exactly how it is suggested by Knuth. It is just that you playing in a shuffled order can't be that random.
  43. iPod metadata by Meph_the_Balrog · · Score: 2, Interesting
    Does the iPod sense higher played songs/albums/groups


    Actually it does. There's a counter for the number of times a song has been played through completely. I believe one of the in-built playlists accesses this metadata.

    Mind you, as to wether the device uses this information to weight its shuffle function is something I have no idea about.
    1. Re:iPod metadata by Firehed · · Score: 1

      I'm inclined to think so, as I seemed to get highly-played songs more often during random playback, almost as a pseudo-rating. Interestingly, it only seemed to happen on playlists, not during the "shuffle songs" entire-library approach (though, that could be because my library is at least ten times the size of my playlists, and I didn't leave it going that often).

      If you do a shuffle of a playlist, album, or library, it WILL do each song one time per set, provided you leave it playing uninterrupted for that long. What seems to happen is that higher-played songs tend to show up earlier in the shuffle, and as docking and several other things break your place in the playback list, you hear them more often since you're not getting through the entire list. Mind you, this is my thought on the matter based off of my own experience, but I wouldn't be at all surprised if the play count has at least a minor effect on it's position in a shuffled playlist. Since iTunes7's introduction of the "skip count" data, I'd be surprised if that's not also minorly weighted and used beyond the creation of smart playlists.

      --
      How are sites slashdotted when nobody reads TFAs?
  44. Soul of iPods by webword · · Score: 2, Funny

    Maybe iPods are showing us their souls. The inner light is shining through.

  45. radio static by Bananatree3 · · Score: 1

    another really easy method is to build in a tiny, one-chip radio receiver inside the mp3-player and tune it to a very little-used frequency. The antenna only has to be long enough to get some good white noise. Radio static is more than random enough to seed a mp3 player.

  46. Humans and dictionaries define random differently by jonadab · · Score: 5, Insightful

    Except for mathematicians and programmers, most think of "random" in a *very* different way from its technical definition. To most humans, saying that a particular sequence is "random" means *guaranteeing* certain things about it. Among them: the same element does not occur back-to-back, EVER, even if there are only a few elements total to choose from. Even more, if there are more than about half a dozen elements, the same element never occurs twice within about five positions. (So if you've got songs 1 through 7 on your iPod, and the first seven played are 5, 3, 7, 2, 4, 1, 6, then the next one has to be 5 or 3, or _maybe_ 7, or it doesn't seem "random" to most people. Yet, the order can't be the same every time through, either.) No element occurs substantially more often than any other element, even over the short term. If the elements have a natural order (e.g., alphabetical), then no three elements that are adjascent in that order can ever occur together in that order, nor should they occur together in the reverse order. (This gets particularly difficult to guarantee when the elements have more than one natural order, e.g., if the elements are people, you can't have three of them in a row by either name or age, or people notice and decide that the order is not random.) Even worse, if the elements can all be categorized into a small number of categories (e.g., by gender), you can't have "too many" from one category in a row. (How many is too many depends on the ratio, but if half of the elements are male and half female, having four of either in a row will make people cry foul, the order is not "random".) If certain elements stand out from the others in some significant way, they can neither occur first nor last. (For instance, if test questions are being drawn from a question bank, neither the easiest nor the hardest question should be first or last; if it is, people will say the order was not random.)

    I could go on and on, but what it really amounts to is that when most people say "random" they mean "carefully arranged in a thoroughly mixed-up order". This is almost the *opposite* of what a mathematician or computer programmer thinks the word "random" means.

    For this reason, when describing a mathematically-random sequence to an end user, I never EVER use the word "random". I generally call it something like "arbitrary" or "unpredictable". This greatly reduces complaints.

    Now, as far as song frequency, I like to rate my tracks on a scale of 1-10, and rig my playlist so that anything under a 6 never plays unless I specifically select it, tracks rated 7 play twice as often as those rated 6, and the frequency keeps going up the higher my rating is. (I only have eight tracks rated as a 10, and they're all things I don't mind hearing back-to-back.) Then if I find a track is playing more often than I like, I figure I rated it too high and cut back its rating.

    --
    Cut that out, or I will ship you to Norilsk in a box.
  47. Problem solved... by NotQuiteReal · · Score: 1
    You only think you like Steely Dan, because others have told you likewise.

    It is analgous to the popularity of Windows - there is no objective reason to like Steely Dan.

    But, deep down, you realize, that Steely Dan represents the worst of the music of the 70's and you are having a visceral repulsion to it, like I finally came to realize, every time I hear Stevie Nix...

    So, rather than blame your nice, techie, iPod, blame your fallable human self for choosing that music.

    If you remove all Steely Dan from your iPod you will no longer have this problem.

    --
    This issue is a bit more complicated than you think.
    1. Re:Problem solved... by Randle_Revar · · Score: 1

      But, deep down, you realize, that Steely Dan represents the best music of all time.

      Fixed :-D

    2. Re:Problem solved... by Anonymous Coward · · Score: 0

      Don't you mean "Stevie *nix"?

      sorry :)

  48. OCD - insightful??? by Anonymous Coward · · Score: 0

    How is this post insightful? It shows clearly that eldavojohn did not even bother to read the article. If he did, he would have noticed the paragraphs about how difficult it is be truly random.

    From the article:
    Robbin is talking randomness in terms that software can reasonably produce, which is not perfect randomness. True randomness, it turns out, is very difficult to produce. This subject was most famously examined by Claude Shannon, arguably the Father of Randomness.
    And from the next paragraph:
    And if you're randomising on a computer, you have to introduce a "seed", which is a starting point for the algorithm that mixes up the selections. The seed must draw on some unpredictable input of time that begins outside the computer. Otherwise, the results would be the same over and over again.

    Now you can rest easy eldavojohn, you don't have to break anything to Mr. Levy, he already stated the facts you so arrogantly pointed out.

  49. No escape from tracks I hate by British · · Score: 1

    My ipod has this tendency to play tracks from the "Buckaroo banzai /saturn 3" soundtrack. It was a bootleg-only soundtrack that has about 8 BB tracks, and about 20 Saturn 3 tracks. I regret ripping it to my ipod. No matter if I use "shuffle songs" or any custom smart playlists, they ALWAYS show up.

    And removing tracks from an ipod was never easy.

    1. Re:No escape from tracks I hate by Anonymous Coward · · Score: 0

      And removing tracks from an ipod was never easy.

      Who in the what now?

  50. Randomness about iTunes. by abhask · · Score: 1

    Something related to iTunes - a study of the randomness of party shuffle in iTunes. This article does a bit of research and comes up with a function! http://www.omninerd.com/2005/08/25/articles/34

    1. Re:Randomness about iTunes. by Bert690 · · Score: 1

      Something related to iTunes - a study of the randomness of party shuffle in iTunes. This article does a bit of research and comes up with a function! Yep, and there was even a previous slashdot story about this very article. The function from the article to describe play probabilities grossly overfits the data. A much simpler formula is more likely correct, as I demonstrated in a comment submitted to this previous story.

  51. I'm surprised no one has pulled out... by sendai2ci · · Score: 1
  52. SmartPlaylists by Anonymous Coward · · Score: 0

    I used to have the same problem on both iTunes and my iPod. However, with some clever playlist structuring, you can get as near to a random experience as possible. Using iTunes SmartPlaylist features is the only way I have been able to stop iTunes (or the iPod) from playing the same handful of songs over and over and over again.

  53. Dupe Tag by sr180 · · Score: 2, Interesting

    And the question remains, why doesnt the DUPE tag work anymore? I liked that tag. Seeing it meant I could avoid the 500 "OMG! Its a Dupe!11!" comments.

    --
    In Soviet Russia the insensitive clod is YOU!
  54. Old news among poker players by Anonymous Coward · · Score: 0

    If you read poker forums at all, you'll know that this is a subject that has been beaten to death over and over. So much so in fact that (at least) one poker site's support has a lengthy form letter they send to anyone that complains about "non random" cards:

    ==================

    Firstly, I assure you that our shuffle is entirely random. You can find its description at the first link below, and the results of two independent audits into it at the second:

    http://www.pokerstars.com/security.html
    http://www.pokerstars.com/rng_audit.html

    We will send any real money player's entire hand history to them at any point that they ask for it. We have every real money hand played on our servers and have sent out literally millions of hands. There are many players out there with 100,000 or more hands in their Poker Tracker database. Poker Tracker is a program that allows you to analyse your own play and by extension the randomness of the site in question. If there were anything that deviated from the expected values, these players would have solid evidence to that effect. However, there's nothing on the poker forums. Infact, some players have posted their investigations online, the URLs for which you can find below. I am certain that there are more out there that you can easily find.

    http://tinyurl.com/4lfeg
    http://tinyurl.com/2nvav

    I am sure that many of the players we've sent these hand histories to felt that there were problems with the game. That's the nature of how our brains work. They are very good at picking out patterns, but when faced with randomness, impose patterns of their own on the data. Our brain is also very good at picking out the unusual from the usual. Therefore, you will not take as much notice of the seven times you win your 7/8 shot, but the time you lose it is the time that will stick in your memory.

    The nature of poker is that the better a player, the more often he will put his money in when he is ahead. Conversely, the weaker the player, the more often he will put his money in whilst behind. It is therefore natural that the good player will not need to outdrawn his opponent very often, whilst the weaker player has to do it with much greater frequency. Of course, the good player makes more money in the long run, but the weaker player will still win pots from him. It's a fact that in the long run, the good player will outdraw opponents fewer times per hour than he will be outdrawn on himself. This is simply because he is rarely in a situation where he has to outdraw someone to win. However, if you looked at every single time a strong player had a 20% shot to win with all his chips in compared to every single time a weak player had a 20% shot to win, you will find that both players did indeed make their hand 20% of the time.

    There are three sets of people who would undoubtably recognise that something was amiss if there were any flaws in the shuffle. The first set is the programmers, the second senior management, and the third the poker specialists (who have access to as many hand histories as they want). All any of these people would have to do is ask for a 100% pay rise with the threat that they will release compelling evidence about the dishonesty. We make our money purely from rake and tournament entry fees. We would immediately lose a lot, if not all of our players as a result of this. The fact that this is not all over the forums, and the fact that I am (sadly) not sitting on a tropical island as I type this mail is a very strong signal that nothing is amiss.

    Finally, the offer to send out every real money hand you've played is of course open to you as well. Just let us know and we can send it along. I recommend a tool like Poker Tracker to run your analysis, but there are plenty of other programs out there that do a similiar kind of job.

    I hope th

  55. Re:Bias - hmm by Anonymous Coward · · Score: 1, Insightful

    Yes, that's a good point (and true). However, the original article is talking about one particular artist being played more often than expected. You're exactly right in saying that the gap between songs from the same artist in a shuffled list is shorter than most people would expect. The article author, however, is probably wrong in saying that the gap between Steely Dan songs is less than the gap between another artist.

  56. Re:Humans and dictionaries define random different by doom · · Score: 1
    Except for mathematicians and programmers, most think of "random" in a *very* different way from its technical definition. To most humans, saying that a particular sequence is "random" means *guaranteeing* certain things about it. Among them: the same element does not occur back-to-back, EVER, even if there are only a few elements total to choose from.
    Yes exactly. I think the lesson here is that you should never use a mathematically random algorithm for esthetic purposes. If you're trying to get something to seem "mixed-up" to a user, you need to simulate a world where the "gambler's fallacy" is not a fallacy: you need a "randomization" function that has memory, and is weighted against "streaks".

    I wrote a CPAN module called Text::Capitalize that includes a function called "scramble_case" that works this way (for when you want capitalization with a "wEiRDly sCRaMbLeD aPpEaREncE").

    If certain elements stand out from the others in some significant way, they can neither occur first nor last. (For instance, if test questions are being drawn from a question bank, neither the easiest nor the hardest question should be first or last; if it is, people will say the order was not random.)
    That's an interesting way of formulating the principle. For my "scramble_case" I weighted the probability against getting a capitalized first letter, because that looks Too Normal.

    I could go on and on, but what it really amounts to is that when most people say "random" they mean "carefully arranged in a thoroughly mixed-up order". This is almost the *opposite* of what a mathematician or computer programmer thinks the word "random" means.
    This, by the way, is esentially the conclusion that Stephen Levy comes to... this isn't a bad article at all, though it's a bit verbose, and doesn't get down to the point until two-thirds of the way through. (Which probably makes it Pulitzer Prize material).
  57. Give it a break by stikves · · Score: 1

    iPod just plays fine :)

    (Ok, sometimes I remember being surprised to see 3 songs from the same artist played consequently. However considering that there are hundreds of songs in total and ~5 from each artist, it would be not-so-random for this to *not* happen in a single run of the playlist. We tend to consider numbers like 444,499,911,101 not random, however it has the same probabilty with all the other 12 digits numbers in a linear distrubition).

  58. speaking as someone who doesn't have any iPod by leehwtsohg · · Score: 1

    Doesn't the shuffle have the best sound quality of the set? (look it up through google)

  59. Winamp by Ahnteis · · Score: 1

    I do the same thing with winamp.

    One of the playlist window options is "randomize list". I just hit that a few times, and then listen through the playlist "straight". Even better is that I can go backward through the same list, and can see what "random" song is coming up next.

    1. Re:Winamp by Ashe+Tyrael · · Score: 1

      And to be honest, this is about the only thing I find really frustrating with the iTunes/iPod way of doing things.

      With Winamp et. al, when you made a random playlist, you added all your songs, and then shuffled it. That playlist stayed the same order from then on. It's that function I miss most in iTunes. I liked having a shuffled playlist that was always in the same order, it suited the way I listened to music (and if I wanted to skip to a particular song, I knew more or less where it was.)

      I keep meaning to check out the status of the Winamp iPod plugin. Chalk it up to the list of things I never get around to.

      --
      "How fine you look when dressed in rage."
  60. Mine always plays the first song in my collection by lisnter · · Score: 1
    My iPod is in my car connected to the radio via an ice>Link CD adapter. I just leave it on shuffle but *every* time the iPod resets (which it does each weekend because the battery doesn't hold a charge anymore) it plays the same first song. This song happens to be the first one in the first directory when Windows sorts my collection by name

    (Unknown Chinese)\(Unknown Chinese)\(Unknown Chinese 1).01.mp3

    The rest of the shuffle seems to be random enough, I haven't noticed any bias.

    I've always wondered about that.

    T.

  61. iRiver shuffle not random? by Anonymous Coward · · Score: 0

    This is a something I've noticed with my iRiver H10; when it chooses a next track "randomly," it seems to be chosen as an offset from the song that just played. For example, I'll often simply select the very first artist (beginning with A) and the very first song. From then on, I'll hear almost entirely artists that begin with the letter A. sometimes it makes it to an artist that begins with B, or back to Z, but it hardly ever hits any other letter.

    Pretty annoying.

  62. Ipod Gambling by Anonymous Coward · · Score: 0

    Beatles pay 5 to 1
    Moby pays 2 to 1
    Slayer and Marilyn Manson pay 10 to 1.
    The doors pay nothing

    Based on this thread I would be lining up the suckers and making some real money.

  63. I have experienced something similar... by Arancaytar · · Score: 1

    With a non-iPod mp3 player. It's played the same song 3-4 times in a row on occasion. (Combined with the unfortunate fact that the "shuffle" only works when actually waiting for the song to end, not when switching through tracks, this can be frustrating.)

    But I'm not convinced it wasn't a fluke. Unlikely things do happen, and the song is no more or less likely to come up after the last nine repetitions.

    If so, then this subjective problem could still be solved simply by slightly disadvantaging the songs or artists that have played recently, so they're less likely to repeat within a short time. iTunes has a similar option, but that does the opposite (making artists more likely to be played in groups).

    1. Re:I have experienced something similar... by Arancaytar · · Score: 1

      Looking back, I probably should have read the article to its end before posting, seeing as that is exactly the conclusion it ends with.

  64. My old iRiver... by MooUK · · Score: 1

    I have an iRiver H320. The stock firmware for that player doesn't do shuffling properly at all. Every time you play something shuffled, it's in the same order.

    The Rockbox firmware solves that, of course.

  65. "The generation of random numbers is... by ergean · · Score: 2, Funny

    too important to be left to chance."

  66. Sony Ericsson W800i by Anonymous Coward · · Score: 0

    Sony Ericsson MP3 phones (at least the D750i/K750i/W800i) have a bizarre feature.

    If you set a playlist to shuffle, it fixes the shuffle order, and if you turn off the the phone, after you turn it on again it finishes playing the current song (good behaviour) then restarts the playlist from the first song (bad, bad behaviour).

    Took a while to figure this out, but I always seemed to hear Iron Maiden first thing in the morning. In my case I put it down to confirmation bias for a while, as what I heard when I started the phone was always different. But I finally realised that the second (and subsequent) song I heard in the morning was the one that was the same.

    New practice - do not turn the phone off at night, or randomly skip a large number of tracks at the first sign of "Different World"

  67. Does iTunes keep track of the iPod play count? by zalt · · Score: 1

    Does the play count for each song in iTunes also reflect the number of times the song has been played on the iPod?

    In that case, can't someone just replace the mp3's on his/hers iPod with 1-second versions and then have the iPod play away for a while. I own an iPod and the thought of it liking some songs/artists more than others has struck me as well, but I've just assumed it's because I react to some songs more than others.

    If the playcount shows up as even this discussion could be ended once and for all. :)

  68. For God's sake... by g051051 · · Score: 1

    Someone please take away Zonk's privileges! Everything he posts is just complete trash.

  69. It's not about randomness, it's about chance by ernst_mulder · · Score: 1

    Well. My iPod has a song on it, called "Herfst en Nieuwegein". Nieuwegein is a small city near Urecht. It already happened to me twice that that particular song played exactly during my passing of the small city in question.

    First you think "somebody's playing with me, that's sooo unlikely to happen!".

    But when you do the calculations it's not so unlikely to happen as you think. 4GB iPod, aout 500 songs (with my encoding of choice). Say 5 minutes per song. Passing Nieuwegein takes me about 7 to 10 minutes, and when the song will play during that time it will be OK. So on average that's about 3 "pickings" (is that the right word) out of 500 songs.
    A chance on average of about 3 in 500, or a chance of 0,6%.

    As we all know chances like that pop up 9 times of of 10. ;-)

  70. Re: Users * Don't Want * Random by TaoPhoenix · · Score: 1

    The earlier Wiki articles on Confirmation Bias are right on the money. I will further emphasize that the user is complaining because of the "excess Steely Dan", which indicates it is a *weaker selection* for his playlist.

    If he had liked Slayer, he should have trumped how pleased "his iPod liked him, and gave him his daily dose of Slayer".

    What Steve Jobs picked up on, is that true randomness includes clumps. Seeds aside, there simply occur odd mini-patterns in a true random event.

    What the user *wants* is "Something Different*. Therefore the best algorithms are ones that *exclude* that same album, and if desired, that same artist, and then shuffle the *remaining* choices.

    I have never been a fan of shuffle. I prefer to take some care and design a playlist properly so the order it comes out in is solid, and if I made a mistake and included a song that wears out too easily... just nuke it. It only takes a few button clicks to start in the *second half* of the playlist too.

    --
    My first Journal Entry ever, in 8 years! http://slashdot.org/journal/365947/aphelion-scifi-fantasy-horror-poetry-webzine
  71. Like Scientoloigists extinguishing streetlights! by Ancient_Hacker · · Score: 2, Interesting

    It's a psychological thing. Like walking by a streetlight and having it go on or off. If it happens again within an hour or so, you're SURE it had something to do with you. Even if it's the same streetlight. Even if you know when the bulbs get old, they overheat and cycle on and off. Every week or so I hear two Bob Dylan tunes back to back on my iPod. Not too surprising, I only have about 60 tunes on there and Senor Zimmerman "sings" four of them.

  72. iPod SHOULD NOT be random. by uncmathguy · · Score: 1

    The problem is, the iPod is TOO random. True randomness guarentees the possibility that a single song can be played 10 times back to back to back to...to back. And nobody wants that when listening to music! The solution? Random for music should mean something different than random. The next track should be different than the one currently playing. Different genre, different artest, different tempo, different key, different . And which different xxxx should not be random either. After a death metal song, I don't want sludge metal (well, I do, but not on random mode). The iPod should pick a song that is truely different than the one I am currently listening to. The point it, in user applications, nobody every wants real randomness. So why do we keep getting it?

  73. What's in a name? by aschrock · · Score: 1

    Everybody I've recommended a shuffle to says the same thing - "but I don't want to play my music randomly." There's a perception from the name of the player that all it does is play music on "shuffle"! So when people perceive it as being not random enough.... a little ironic, no? Maybe Apple should have just called it the "nugget" or "nibble."

  74. Feature Request by jscotta44 · · Score: 1

    Excellent. Have you submitted a feature request to Apple?

    http://www.apple.com/feedback/ipod.html

    Believe it or not, I don't think that the Apple product managers read /. :-)

    1. Re:Feature Request by NeMon'ess · · Score: 2, Interesting

      Almost two years ago.

      Then they changed their form so they no longer accept feature requests for iTunes, only iPods. As for my request, iTunes 6 doesn't remember where I was in a playlist after closing the program, does version 7?

      It only took Apple three or four years to incrementally improve their Shuffle feature. I'm sure I just need to wait another year or two for my request to get implemented.

      Maybe in another two or three years enough people will have asked Steve Jobs to get the Shuffle feature to play songs sooner that haven't played in a while. Now that version 7 (are the bugs fixed yet?) notes when a track was skipped, maybe version 8 will actually do this.

    2. Re:Feature Request by jscotta44 · · Score: 1

      I agree that Apple has a nasty habit of prioritizing feature request implementation according to the number of people that request it. Maybe if the /. crowd can be convinced to actually type in a useful form, then you can have the /. effect for a feature request - just overwhelm Apple with so many well thought out feature requests that they just have to act immediately to please the masses - wait a second, I what was I thinking. This is SlashDot.

      Seriously, you seem to be on to something. However, Apple is not going to do it without some significant indication that it is a feature that a significant portion of its users or potential users claims to want.

      As to bugs in iTunes 7, I have it installed on 25 Macs (a mix of PPC and Intel) and have seen none of the reported bugs. No one in my rather extensive group of known Mac users has reported any bugs either. That doesn't mean they don't exist. Just that I have not personally seen any evidence of them.

    3. Re:Feature Request by Grishnakh · · Score: 1

      Then they changed their form so they no longer accept feature requests for iTunes, only iPods. As for my request, iTunes 6 doesn't remember where I was in a playlist after closing the program, does version 7?

      Amarok does this quite nicely. They also happily take requests for new features.

  75. Re:Humans and dictionaries define random different by Anonymous Coward · · Score: 0


    For this reason, when describing a mathematically-random sequence to an end user, I never EVER use the word "random". I generally call it something like "arbitrary" or "unpredictable". This greatly reduces complaints.

    Computers are eminently predictable. Give them the same inputs and they'll always return the same outputs. You can try to fake an entropy pool, but if you replay the inputs you will get the same outputs. There is no randomness in computers. Unless the iPod is keeping some history of user inputs or time, or some outside-the-iPod change, then the mathematical formula that decides the order of the songs will return the same sequence again and again.

  76. Intersting by PurdueGraphicsMan · · Score: 1

    Recently while mowing my grass I noticed that my iPod seemed to have a certain affinity for Sting. However, since I have just about every Sting album ever released I figure it's bound to show up a bit more often than some other artists. What I thought was odd was that it played like 4 Sting songs right in a row. The possibility of that happening seems remote considering I have around 3,000 songs on my iPod right now.

    --


    The guitars sound good, now give me about 10db more on the cow bell.
  77. Same song, two versions by mike3k · · Score: 1

    The other day my iPod played Rachid Taha's cover version of "Rock The Casbah" followed immediately by The Clash's original version.

  78. I've seen this! by ckotchey · · Score: 1

    I've definitely seen this seemingly non-random randomness in my own iPod, but not quite to the degree that the author has. I have definitely noticed that although the "shuffle songs" does seem to randomize everything, it will DEFINITELY favor 2 or 3 particular artists after each shuffle. If I happen to start a particular mix, after about the 7th or 8th song or so, I will definitely hear higher-than-"normal" repetition of 2 or 3 of the artists that I've heard in the first opening segments.
    As to whether or not this is a good thing - depends on who it decides will be its favorites for the day (or for that particular "shuffle session".

  79. LOL by Anonymous Coward · · Score: 0

    Mine LOVES Jimmie Buffet!
    I don't particularily care for his stuff, but it can'tgo 5 minutes without playng a Jimmie Buffet Song!

  80. ipod aint the only one by jax9999 · · Score: 1

    My ipod likes Greenday, but my itunes liked coldplay... I think they don't like each other.

    When I sync up my ipod using the autofill it almost always loads up pretty much every coldplay song I have, but when I'm playiung the songs on my ipod it sticks to wathever greenday songs I have on there. Who knew that two pieces of technology could have such different tastes?

  81. Random numbers naturally cluster by Anonymous Coward · · Score: 0

    Look at a scatterplot of 2D (pseudo)random numbers. It naturally has overdense regions and underdense regions. (By comparison, a scatterplot of "quasirandom" numbers appears more uniform; see more here.) This has nothing to do with poor pseudorandom number generation, psychological perception of nonexistent patterns, etc. — random numbers really do cluster at times. This led British citizens to believe that V-bomb strikes in South London had a particular pattern to them when they were really dispersed randomly.

  82. What about Enforced Shuffle? by justthinkit · · Score: 1

    Wouldn't this solve the problem completely? Every song that gets selected for play is removed from a stored list. Once the last song is played off the stored list, start again. Man, I'd...I'd...I'd even consider giving up my 78's for this feature.

    --
    I come here for the love
    1. Re:What about Enforced Shuffle? by /dev/trash · · Score: 1

      How much spare memory do you think the iPOds have?

    2. Re:What about Enforced Shuffle? by justthinkit · · Score: 1

      I imagine available RAM is measured in megs, but the space to store a list of songs played would be measured in smaller amounts -- say 6 digits per song, in a string like "000001 000004 000008 ..." -- that would come to 7000 bytes for 1000 songs. Sounds like a pittance. Yet even if this cramped the style of a single digit of megabytes device, at least it would solve the problem for my 60GB one. And I would wager that the majority of devices have gigs rather than megs.

      --
      I come here for the love
  83. Thanks Billy... by Mr.+Underbridge · · Score: 1

    ...I think we're all dumber for having read that.

  84. Why must shuffle be truly random? by robmandu · · Score: 1

    How about a shuffle that actually does what I want: play all the songs in the library (or playlist) just one time each in a random order? Yah, sure, I can manually sort my playlist... but that's only good for one pass.

    BTW, I think the confirmation bias being linked to over and over and over again is confirmation that those chuckleheads are biased towards being theoretically correct about random-approximating procedures in automata... instead of focusing on what the users actually want.

    --

    --
    Break the rules. Keep the faith. Fight for love.
  85. It can't really be random by Anonymous Coward · · Score: 0

    Acording to Apples web site, the ipod shuffle holds 240 songs. That means there are 240! orders they could be played in. That's about 4x10^468 acording to my calculator. If we start with a 64 bit random seed, that's only about 2x10^19. Since the random seed will determine the playing order, there is no way the shuffle can be random with out some form of entropy generator which would cost too much to be worth while.

    That said, most of what people claim as evidence that it's not random are really just coincidences.

  86. Nearly by Anonymous Coward · · Score: 0

    Since you can hear the same song again, it's actually 1* 20/400.

  87. In Soviet Russia.... by DavidD_CA · · Score: 1

    In Soviet Russia... iPod shuffles YOU!

    (Sorry.)

    --
    -David
  88. the iPod knows by obis · · Score: 1

    The iPod is programmed with software that prevents the user from making irrational decisions, for example the iPod knows a decisions like "Should I delete Weird Al's Polkamon?" is an irrational decision. This helps the user focus on more useful activities like practicing dance moves for Apple commercials and music video auditions. Makers of The Zune plan on taking this technology to another level with blue-screen-saver's. When attempting to delete tracks like Weird Al's Polkamon from the Zune, the user will be greeted with a vibrant blue-screen followed by error codes and a dialog for updates. These are not true error codes, this is the Zune prompting the user to rethink her decision to erase Weird Al's Polkamon, blue-screening will be an inherent function of the zune that will change the way we think about mp3 players.

    --
    "Say, Bill. Would you rub some of this powder on my lips?"
  89. Re:Humans and dictionaries define random different by jonadab · · Score: 1

    > There is no randomness in computers.

    I don't know what's available on the iPod hardware, but in a desktop scenario, I generally multiply the pseudorandom number from whatever standard rand function is available by the hundredth-of-a-second value off the system clock and then use modular arithmetic to get the result in the range I need. This is almost certainly not cryptographically sound, but it is good enough to seem unpredictable to most humans, so it's a good start for things like shuffling a playlist or pulling questions from a test bank.

    You generally still want to fudge the results in various ways to make them appear more "random" to the user, though. It's easy to seem unpredictable, but you have to work a bit more to achieve "random". (Note here that I am using "random" here in the sense end users generally understand it, *not* in the math/programmer jargon sense. Even when I do various fudgings to make the results seem more "random", I still avoid using the _word_ "random", because that word sets the users' expectations pretty high, and I'm usually not that confident in my fudging algorithms.

    --
    Cut that out, or I will ship you to Norilsk in a box.
  90. Re:Like Scientoloigists extinguishing streetlights by vga_init · · Score: 1

    It may be superstitious, but sure is a freaky thing to experience. When I worked late nights at the office, I would walk a secluded path to the parking lot that was a bit out of the way (but the end of the path was closer to my car). There was a particular light that often turned off when I walked by it. I always just chocked it up to the fact that I walk out of the office usually at the same time, but even a sensible person like me gets surprised a few times by something like that. :)

    I can't help but wonder, though, if my presence didn't have some sort of effect (for example, my footsteps causing a harmonic vibration to reach the light mechanism, which caused it to reach a state of change sooner than it would have all by itself). The reason why I think that is because I can't recall ever seeing the light go off before I arrived at it. Maybe I did and my brain rejected the memory of it. o_O

  91. Always Check the Obvious by Nom+du+Keyboard · · Score: 1

    Are you sure you don't have that same toon in your iPod more than once? That alone would explain more often replays.

    --
    "It's the height of ridiculousness to say for those 9 lines you get hundreds of millions."
  92. random and human belief by boyfaceddog · · Score: 1

    True randomness is the stuff of magic to humanity. Randomness has inspired just about everything "mystical" or magic in our understanding of the universe. Look at the discussions raging about creationism vs. evolution. People believe God created the universe becasue humans can't wrap their minds around the idea that in a random univers, all things have a chance of happening. What we want from our randomness isn't "all things", its one-each of everything. The one-each randomness is what human s truly believe, deep, deep down inside, to be random.

    Steve Levy should know better, but I can't think of a better way to illustrate the differences between real randomness and the human perception of randomness.

    Steve, its random already.

    --
    Here will be an old abusing of God's patience and the king's English.
  93. Random != Shuffle by Anonymous Coward · · Score: 0

    Apple is peopled by Human Interface idiots. It would be easy to add a "Shuffle" as well as a "Random" (especially to something NAMED SHUFFLE).

    Shuffle means "shuffle the entire list of songs and play them in that order".

    Random means "pick a random song, from the entire pool, and play that, everytime a song is played".

    You can get an annoying Madonna song 5 times in a row with random, but once and only once per list with shuffle.

    Shuffle is almost always better with any list shorter than [some amount to be determined].

    Fucking iTunes will shuffle, but I don't believe it does random (well, party-fucking-"shuffle" randomizes), the fucking iPod will randmonize but it won't fucking shuffle.

    Really, Steve "I invented everything at Apple" Jobs doesn't care about this, nor about you, nor about anything other than his ego. So I offer a reward to anyone who can tie this to his ego so something gets done.

    And if someone could explain this to Steven "I'm myoptically focusing on one part of the picture to exclusion of all else" Levy I'll be grateful. No reward, but I'll be grateful.

  94. Re:your sig by weierstrass · · Score: 1

    (without freedom)

    --
    my password really is 'stinkypants'
  95. Wish I could use my smart playlists on an iPod. by argent · · Score: 1

    I'd much rather have an iPod that supported smart playlists fully than one that played videos.

    I have a set of playlists based on ratings and a few arbitrary decisions about how often I wantto hear certain genres.

    best: rating is 5 stars or rating is 4 stars and genre is not like "classical".
    good: rating is 4 stars or playlist is "weird but good". ...

    Then I have a second set of playlists like this:

    day: Playlist is "best" and last play time is not within the past 24 hours.
    twoday: Playlist is "good" and last play time is not within the past 48 hours.
    week: Playlist is "weekly" and last play time is not within the last 7 days.
    fortnight: Playlist is "fortnightly" and last play time is not within the last 14 days.
    month: Playlist is "monthly" and last play time is not within the last 30 days.

    Then a meta-list:

    Playlist is "day" or playlist is "twoday" or playlist is "week" or playlist is "fortnight" or playlist is "month".

    THAT list goes into party shuffle.

    That produces a mix that's rarely predictable enough to be boring but still predictable enough to be comfortable. But the iPod can't handle it. :(

  96. LTBSD by brocktune · · Score: 1

    I'm guessing the LTBSD was hey... nineteen?

  97. Re:Humans and dictionaries define random different by 3choTh1s · · Score: 1

    THANK YOU! I know a lot of geeks who understand that text book random could have to 2 values that are ordered next to one another, can also be next to another in a "random" sampling. What they can not fathom in their wildest dreams is that, that kind of random is not what people are looking for. They'll say, "But if you don't let the values be next to each other then it's not really random." And I have to keep reiterating that it doesn't matter. I don't want to hear 3 Crystal Method songs back to back(even when they are in different albums) when I have 500 hundred songs from other artists that I want to hear.

  98. Replacing iTunes with a very small Perl script by drouse · · Score: 1

    (Which is almost on topic)

    Back before I was using iTunes, I had a combination of a somewhat odd directory structure and a simple Perl script controlling mpg123 to handle my "random" shuffle.

    The way it worked was this:

    A command line option specified the depth of the repeat stack. The repeat stack was where the file names of the last x played songs were stored (FIFO). The repeat stack was used to prevent the same file name from being played more than once every x songs.

    Another command line option specified the starting place in the directory structure.

    When run, the script looked in the the starting folder and built a list of any '.mp(2|3)' files *and* any subdirectories then choose randomly from the list. If it selected a directory it would move to that directory and choose again, if it selected a song file it would pass it to mpg123, put the file name in the repeat stack and then start the main loop again (going back to the starting directory). If it selected a song file whose file name was on the repeat stack, it skipped the song and went back to the main loop. If a directory had no song files it would build a list of subdirectories and then choose one of them -- if it ran itself into a dead end, it would go back to the top of the loop and the main directory.

    So, yes, if the repeat stack was larger than the number of available song files, it would eventually just sit there and do nothing.

    To 'organize' my song file collection what I did was have my mp3s mostly in directories and subdirectories by genre, group, album but with some directories arranged more haphazardly and containing mixes of song files and sub directories.

    Obviously, the more buried the song file was in the directory structure, the less likely it would play. So some of the stuff I had collected, but didn't always want to hear, so I would bury those files. If I was in the mood for a specific genre I'd just start at that genre's place in the directory structure. If I was going to let it run for a long time and didn't want to hear the same song twice, I'd just make the repeat stack really long.

    It worked well, and I was experimenting with the option of a true random walk (i.e. don't return to the top of the directory structure each time and allow it to choose to go "up" in the directory structure as well as down) and the announcing of the song by taking the text of the tags and creating a mp3 file and playing it (or at random intervals saying "This W C R A Z Y, the time is X XX").

    But then they released iTunes, and I got fat and lazy.

    --
    -- I browse at +5 with stripped sigs ... Ha! Ha!
  99. Every mp3 player I've seen I've seen does this-- by hairyfeet · · Score: 1
    It isn't just the flash Ipod. My Sandisk 1GB will always play "You can still rock in America" first if I haven't used it in a couple of days.It also loves anything from the Radio Sunnydale and Queen of the Damned soundtracks. My two best buds at school both have different model Ipods (one a 5th generation,the other a third) and the 5th seems to like Slipknot while the 3rd prefers Korn. And my Sandisk really hates Rush and Hatebreed. If I want to listen to either I have to choose "By Artist".

    I have no clue as to why,but for whatever reason all the mp3 players I've seen tend to prefer certain songs. Maybe it's the randomising algorithm, Maybe it's just a quirk.As long as my Sandisk keeps holding up as good as it has I'll be happy to let it have it's likes and dislikes.

    --
    ACs don't waste your time replying, your posts are never seen by me.
  100. Randomness Mein Arsch by weasel5i2 · · Score: 1

    Let's not forget that microprocessors aren't capable of generating true randomness. An external source of entropy is required, such as a Lava Lamp, decaying Cesium-137 atoms, or something else..

    Now, I gotta say it would be pretty cool if these iPods use a vibration-sensing mechanism to gather enough entropy to seed the PRNG!

    --Weasel

    --
    [BEGIN PGP PUBLIC KEY]: X5O!P%@AP[4\PZX54(P^)7CC)7}$EICAR-STANDARD-ANTIVIR US-TEST-FILE!$H+H*
  101. Re:Humans and dictionaries define random different by nasch · · Score: 1
    Unless the iPod is keeping some history of user inputs or time, or some outside-the-iPod change, then the mathematical formula that decides the order of the songs will return the same sequence again and again.
    Yes, but if it repeats that sequence every 6000 years, it really doesn't matter. Modern pseudorandom alorithms are very good. This completely ignores the issue at hand, which is that randomness is not what people want anyway.
  102. Re:Humans and dictionaries define random different by Kazoo+the+Clown · · Score: 1

    Except for mathematicians and programmers, most think of "random" in a *very* different way from its technical definition. To most humans, saying that a particular sequence is "random" means *guaranteeing* certain things about it. Among them: the same element does not occur back-to-back, EVER, even if there are only a few elements total to choose from.

    With this sort of definition, you will probably find that "random" means something different to just about everybody. It sounds like what you want in music sequencing is something that is a little more equally distributed-- that is, all the artists are equally distributed over the total playing time of the entire shuffle sequence. Or maybe what you really want is to have all the "moods" equally distributed. Or tempo, or genre, or... To achieve that sort of thing you probably want some kind of permutation and not a complete dice-roll, with just a dice-roll to get you to the first choice in the permutation so sequential runs won't get you the exact same sequence... Still, people will then complain because every time they hear Dylan song A it's always followed by Britney Spears' song B, as that's something that they'll notice before long. That suggests a more complex form of permutation combined with a dice-roll is in order.

    Randomness or apparent-randomness is not as simple as many people think. I've been programming computers for over 20 years now, and I've seen a lot of code written by programmers who clearly didn't understand randomness very well-- in the "early days" you'd be amazed at the really bad random number generators that were built into many languages. It wasn't uncommon to just walk a pointer through all of memory and pick up whatever bytes were found as a random number source, which produces really abysmal results. Also, it can make a surprising difference in the quality of the results of programs dependent on them. There's a lot of non-intuitive things that come into play almost immediately when you delve into the subject. (see This Book for some juicy ones). And while I don't consider myself an expert on the subject I have gained a respect for the complexity of seemingly simple problems in randomness-- and avoid inventing ad-hoc randomizing solutions.

    One example of subtlety is the easy-to-implement "swap" method of mentioned in related threads above doesn't really give you very good shuffling if you only pass over the deck once, and gets worse the shorter the card deck is. I've always preferred sorting an array of random data along with the indices and utilizing the indicies as the shuffled deck, though that too could have some non-obvious quirks-- certainly it's very dependent on the quality of the random number generator being used.

    With regards to music shuffling-- I don't think it's a very good idea in the first place, as you'll always be likely to set tunes with completely different moods against each other which will be likely to grate even if you like both tunes. It's better to take the time and manually make some good playlists, IMHO-- they don't pay radio station program directors the big bucks for nothing...

  103. Re:Humans and dictionaries define random different by jonadab · · Score: 1

    > I think the lesson here is that you should never use a mathematically
    > random algorithm for [a]esthetic purposes.

    You can use a standard rand() function as a starting point, but you have to fudge the results considerably. Also, using rand() is not the only way to achieve random. I have a program that generates twenty-question quizzes from a large bank of questions. For some things (e.g., selecting which questions to use) it uses rand() as a starting point and then fudges in various ways (e.g., tossing out questions whose answer references the same place in the source text as a question that has already been selected), but once it has selected which twenty questions it's going to use, it goes into decidedly-not-mathematically random mode to determine how to order them. Basically, it extracts the four special questions (two finish questions and two reference questions) and places one of them in each of four five-question quarter-quizzes, then it *sorts* the normal questions according to the order of their references and puts the first one in the first quarter, the second in the second quarter, and so on (wrapping around to the first quarter after the fourth). It does then randomorder each quarter and subsequently does a little more fudging (e.g., to make sure that the first and last questions of the quiz are not special questions)...

    > For my "scramble_case" I weighted the probability against getting a
    > capitalized first letter, because that looks Too Normal.

    Yes, that's exactly the sort of thing I'm talking about. If half or more of the words started with a capital letter, the scrambling wouldn't look "random" enough. It's a real paradigm shift from the meaning of random in computer science 101. It's the same reason my quiz generator must guarantee that the first question and the last question of the quiz are neither one ever a finish nor a reference question, even though with a mathematically random arrangement they (each) would be about a fifth of the time, over the long term. But if it happens even once, people complain that the quizzes aren't random and we should get a computer to do them. Most of the quizzers assume they're arranged by hand, but that would be a lot of work. However, even with all of the fudging I have built into the program, I still have to look over the quizzes before each rally and check that nothing went wrong and the quizzes are "random" enough. It just wouldn't do to have e.g. five "Why" questions in a row or some such oddity.

    --
    Cut that out, or I will ship you to Norilsk in a box.
  104. "Random" doesn't seem random to me either. by tggreen · · Score: 1

    I think the birthday paradox has something to do with it, but there still seems to be something wrong with the "random play" mode of iTunes. And random mode on my Squeezebox is even worse. With iTunes, I was able to help things by pushing the "smart shuffle" preference toward the "less likely" end. I have the smart shuffle preference one notch away from the very end of "less likely", and something still seems to be wrong. Supposedly, this setting would make iTunes play almost everything in my song library before repeating a tune. Doesn't seem to be working that way. I still hear a lot of repeats. And I have over a half-dozen songs (out of 176) that seem to never get played by the random shuffle selector, e.g. "Strip My Mind" by the Red Hot Chili Peppers. I've been trying to discern a pattern for what is happening. I don't have any compelling statistical proof, but the following seems to be the case: * When a particular song is playing, iTunes seems to be biased toward songs that are nearby on the play list (in alphabetical order). I have all 176 songs in a single large "album", and I get the impression that when it shuffles to the next song it seems to take small jumps around the alphabet based on the first character of the song name. * When you play the shuffle with a particular song, it seems as if the identity of that song sets a randseed. There seems to be not only repeating songs, but also to some extend repeating song patterns. None of the above is scientific, and I could be totally wrong. As some other posts have pointed out, it seems like an algorithm that shuffles the songs like a deck or cards and then deals the entire deck works better. Using quasi-random algorithms rather than pseudo-random algorithms might also be worth trying. I would also be interested in an algorithm that could look at the audio properties of two MP3 files and attempt to determine if playing the two songs in sequence would sound good (i.e. something that could avoid playing punk rock right after Yanni). Maybe something with a tuning knob what I could use to indicate my "mood".

  105. What about my problem? by Swift2001 · · Score: 1

    I have about 50% CDs, 20% out of the iTunes store, and the other 30% from various free sources -- very, very few off of Napsterish sources, honest, but the rest from artist's web sites, free samples, other cuts from Salon or other places that give away a free song or two. And when I play music from my iPod, I never recognize a thing? It seems to me that most of the time, I'm surprised, even when I'm hearing something familiar. (Oh, listen to that guitar lick. That lyric says THAT?) That kind of thing.

  106. patterns in static by pixelguru · · Score: 1

    No matter how random something is, the human brain will always try to find patterns in it, and if there isn't one, we make something up. Constellations, cloud formations, potato chips and grilled cheese sandwiches...

    ...but with that said, I have an iPod that loves 80's hair band metal.

  107. People don't say what they mean either by EmbeddedJanitor · · Score: 1
    Yes, this is true and I'd mod you up if I could.

    There is a very big difference between the mathematical definition of randomness and what people mean when they say they want randomness. When you design a product and say it is random, then you're bbetter off trying to fit in with what people expect when they say random, rather than a strict mathematical definition.

    --
    Engineering is the art of compromise.
  108. Re:Humans and dictionaries define random different by jonadab · · Score: 1

    > Yes, but if it repeats that sequence every 6000 years, it really doesn't matter.

    True, but...

    > Modern pseudorandom alorithms are very good.

    Not in this context. Pseudorandom algorithms approximate *mathematical* randomness.

    > This completely ignores the issue at hand, which is that randomness is not
    > what people want anyway.

    Exactly. People think they want "random", but they don't want mathematical random. They want things carefully and thoroughly mixed up in an approximately _even_ distribution with no proximate repeats and no naturally-ordered subsequences of any significant length, among other things.

    --
    Cut that out, or I will ship you to Norilsk in a box.
  109. Completely random, eh? by Anonymous Coward · · Score: 0

    I guess my Shuffle must be broke, then.

    Because if all it does is shuffle the entire playlist why do I often get the same song seperated by just one or two other songs?

    I'm not daft enough (yet) to put dupes on the shuffle, and it happens too regularly to be explained purely as the join between one instance of playing the playlist and another.

  110. Re: Bias - hmm by gidds · · Score: 1

    Good point, but if we're talking about the same problem (how many people do you have to get before it's likely that two share a birthday), then the number's only 23. Once you reach 40, then the probability of a birthday match is about 90%. More here.

    --

    Ceterum censeo subscriptionem esse delendam.

  111. Random needs more presence in reviews by pjp6259 · · Score: 1

    For several years, I have been using random/shuffle modes as my primary listening method. Things are probably getting better now, but for a long time random just didn't work well on most consumer devices. This was always something that I wished was covered better in reviews, but it's very time consuming to test correctly, and since it was rarely reviewed, I think most companies felt that as long as they had some sort of random mode, it didn't matter how good it was.

    In one particularly memorable instance, I was listening to a CD on random in my car. This CD had about 30 tracks on it (a TMBG album), and when I played it on random, I consistently got two consecutive tracks in a row. e.g. it would play 4,5,18,19,10,11,7,8,12,13,etc. This only happened with this CD, but I think it showed an interesting failure mode of their random algorithm.

    --
    Computers don't make mistakes. What they do, they do on purpose.
  112. Here's the real story by steven · · Score: 1

    The link a year ago was to my column in Newsweek. This current one is to a book excerpt (which references that column and the reaction to it, and the ensuing events) from my just-released tome, "The Perfect Thing: How the iPod Shuffles Commerce, Culture, and Coolness." Hope that clears it up, folks!