Sunday, May 20, 2007

The two nudist streakers that fall in love over the internet

As a nudist I was very pleased when I saw this video on a random website: The end of the video gives a link to the site believeindestiny.com, and only then did I start to get the feeling it was fake. I mean, it doesn't say directly, but it says
We gave people the chance to vote about what they thought should happen with stories like these: Should companies make stories and websites like these, or should they stick to normal ads? We asked whether they thought they’d been lied to or whether they enjoyed the story? Where does entertaining advertising stop and invasive manipulation begin?
So I look at the vote results...
Are stories like scott and emma's okay? 54.3% yes, advertisers of the world, go nuts and entertain me 22% yes, but only if at the end I am told it was a story 16% no, you should tell me from the start that it's fiction 7.7% no, keep ads in ad breaks and entirely separate from entertainment
I find it hard to believe that, in general, the majority of people don't care whether a story that is presented as the truth is actually false. If that's so, my faith in humanity is all but lost. If viewers don't mind in this case, I think it's probably because either
  1. They do not identify with nudists or streakers and don't care about the truth because it doesn't affect them on an emotional level, or
  2. They suspected it was fake already
Oh, and it could also be the biased phrasing of the poll question.

But I was affected on an emotional level--I thought it was an awesome and sweet story--and I didn't suspect it was fake because it looked convincing. If it were fake, it probably would have required a significant budget to put together. So why would it start and end with defects that look like playing and pausing a VHS tape? Why the low video quality? It was an effective psychological trick. Which brings us to motive: why make up a story like this? The website considers it advertising, but advertising for what? They weren't selling anything, so it just didn't look like an advertisement.

I conclude their motive was the value of market research. It's an experiment in viral marketing and an experiment in how much BS consumers are willing to tolerate. Their poll seems to show that consumers don't mind being lied to, which reminds me of the Iraq war and Bush administration's success in obtaining a second term. But I think reality is more complex. I suspect the poll result can be explained by human selfishness, by apathy. I think their tolerance has more to do with the fact that the story didn't affect them. If they were nudists, less of them would mind the lie. Same goes if they were in the military, or in Iraq.

Wait, wait, I'm connecting viral marketing with the war in Iraq? Good heavens, what's wrong with me?

Friday, April 27, 2007

Net Neutrality

Click the title for an entertaining primer on Net Neutrality in the U.S.

Large broadband providers have some cute little arguments about why they oppose net neutrality; they say that by prioritizing packets, they can offer a needed service to those who are willing to pay for it. But the real issue is not prioritizing traffic; it's degrading traffic--slowing down whoever doesn't pay extra, by letting "priority packets" suck up most of the bandwidth.

Now I don't understand the economics of the network neutrality debate in detail. But when I see that huge incumbent telecom corporations are opposed to neutrality while those in favor are web site operators, medium-size businesses, and grassroots activists, that's almost enough for me to make a ruling by itself.

And then there's the fact, as Harold Feld explains in the above article, that we actually had Net Neutrality during the whole time period in which the internet was growing to be the wonder we enjoy today, and we are only losing it now. Yes, you could always buy a bigger or smaller internet connection at your own "edge" of the internet, but traffic was treated equally in the "middle" of the internet, as it moved between endpoints.

So I'm generally in favor of Net Neutrality, but I wonder if there isn't some merit in packet prioritization to improve "low-latency" services. If you use the internet for voice calls, you'll notice that one of its longstanding problems is lag and dropped packets. Sometimes, seemingly at random, bits of voice will be cut out of voice calls, and other times, it will take a long time for sound to go from one person to the other. Similar problems can arise when playing online video games, in which there is a delay (commonly called lag) between when a person acts and when other players see that action. While often part of the problem is imperfect software, another part of the problem is the route your voice takes through the internet. If your voice travels through a region of the net that is heavily loaded, packets may get through after a delay, or be dropped completely. For that reason, players of many online games prefer to play on servers in their own city or region. Gamers call the delay "lag", but the technical term is "latency" (the lower, the better.)

What's interesting about voice and online games is that they probably take up very little of total online traffic--I would guess less than 10%. That's because the bulk of traffic involves downloading. When you're downloading something, such as a video, it's no big deal if each individual packet takes 3 seconds to go from a web site to your home computer--what matters is that you get as many packets as possible. You want them to come "as quickly as possible", not "as soon as possible". But when you're in a voice call, it doesn't matter if you have a slow ISDN line or the latest mega-speed cable modem. The higher speed line could improve the audio quality a little, but it can do nothing to make data arrive sooner because your voice must compete with downloads and such to get through.

If we don't have net neutrality, there is clearly a risk that large corporations will find a way to make most people pay more, by improving the service to some at the expense of others. But what if we came to a compromise on net neutrality, in which at least 90% of all traffic in any given pipe must be treated neutrally (no discrimination against specific traffic allowed), while up to 10% of traffic is allowed to move more quickly?

In this way, some users and service providers would be allowed to buy a piece of that 10% in order to transfer low-latency data more quickly. That way, "premium" voice packets can be moved to the head of the queue and protected from loss in a busy pipe. With a limit of 10%, there is not enough non-neutral traffic to really slow down the neutral traffic. What do you think?

Wednesday, April 25, 2007

Electoral Reform

I wrote an undergraduate paper on electoral reform last year (Feb. 2006) and it's still a good introduction to voting systems. A country's electoral system could have a big impact on election results and the way in which campaigns are run; the most common First-Past-The-Post system is the least fair, so I encourage you to look at the the others. The paper was intended for Canadians. If you don't live in Canada, well, tough cookies. After reading my paper you can move here at your leisure.

Here's to free speech

Let's take a moment to thank the EFF and other public interest groups for their support of free speech. It's worth thinking about the consequences of ever losing it:
In many countries a journalism student covering a demonstration of school children would be commended for his initiative. In Syria, student Mesud Hamid posted photos on the net of Kurdish pupils demanding equal rights. He was arrested while taking an exam at university. "I was tortured," he said. "For one year and three months I was held in a cell measuring one metre by two. I didn't see the sun or sky for all that time." - BBC article
In North America we take it for granted. We shouldn't.
"Our enemies are innovative and resourceful, and so are we. They never stop thinking about new ways to harm our country and our people, and neither do we."
My Chinese former roommates seemed incredulous at my claim that the Bush poster on my wall, which makes fun of his many mis-statements, would be legal in the U.S. Unfortunately, they do not seem to understand the importance of free speech. On the other hand, maybe it's only fair: I can't understand those who actually want their government to suppress speech that its leaders don't like. And you know, governments never stop at suppressing opinions; they suppress inconvenient facts too, and they often oppress the people who have disseminated "undesirable" messages.

Thursday, April 19, 2007

Municipal WiFi

(Edited April 21)

Competition in broadband and cell phone services is poor; prices are much higher than they could be, both in the U.S. and Canada. That's interesting given the fact that the monopolistic incumbent companies rely on resources, such as the radio spectrum and conduits over and under roads and homes, that on a fundamental level don't belong to them. These resources belong to the public, but the government has granted them permission to use these resources by various licensing schemes, typically at a fixed price set long ago, while letting them keep all the profits.

Now, of course, it is necessary to let somebody use them, or they would be wasted. And without some regulation of the wireless spectrum, the resulting free-for-all could lead to a tragedy of the commons. So the airwaves must be regulated, but it must be done carefully or monopolies arise, leading to high prices and artificial scarcity. The trouble is that has already happened. Prices are high and the wireless spectrum is not used efficiently. Consider Wi-Fi; using an 802.11 wireless network, users can get speeds as high as 54Mbps (= 6.44 megabytes per second) which is 27 times faster than a 2 Mbps DSL internet connection in my area. Even if an area is congested, with many users on the same network, your data still transmits through the air faster than it can across the internet. Yet, you can buy your own personal wireless router for under $100 (and sometimes under $50).

I find it interesting that while I have my own personal wireless network almost for free, but I have to pay $30/month to use the cell phone network for (at most) a few hours. And that's just voice. Internet access would cost an additional $100/mo for only 250 MB of traffic. For comparison, a 54Mbps Wi-Fi router can (sometimes) transmit 250 MB in under 40 seconds. Maybe one of the reasons they can charge so much for so little is that on the cell network, that amount of data could take hours to send.

Imagine, now, if there were a network of Wi-Fi routers that provided internet access from anywhere in a city. How much do you suppose that would cost? It's clear to me that the prices of incumbent cell phone providers could be undercut by a huge margin. It's not my idea; it's called municipal broadband or municipal wi-fi and it's been proposed by many city goverments, smaller companies and public interest goups. Google has even implemented it in its home town. In addition to internet, services such as Skype would make it possible to use the network for calls to ordinary phones at low rates. If municipal broadband took off, Skype and other companies would certainly produce Wi-Fi phones that work like ordinary cell phones, except at much lower prices.

Naturally, the powerful telcos have been lobbying state and federal govenments to ban these networks. The sad thing is that governments have a curious tendency to listen to them.

The reason you can have your own wireless network for so cheap is that the spectrum used by wi-fi is unlicensed. It is still regulated by the FCC in the U.S. and the CRTC in Canada--in particular, power output is limited, so these devices cannot have a long range--but no one has been granted an exclusive license, so anyone can use it. Decades ago there might have been a valid argument that this free-for-all would have a tragedy of the commons effect, because the signals of so many "free riding" users would step on each other, leading to a chaos of noise that would destroy the value of the band for most practical purposes.

This has not happened. Even in crowded places with many devices in use, access only becomes slower, not worthless. An important reason for this is that digital technology is used in this band, technology that can automatically and instantly negotiate with other devices to share the channel efficiently. Even if there are a few "bad" devices on the band that do not play by the digital rules (e.g. microwave ovens and cordless phones), the devices can switch to different channels and/or retransmit lost signals automatically in order to get the data through.

Now, today's wireless signals are usually point-to-point, meaning that transmissions only have one destination, yet current wireless gadgets transmit (roughly) equally in all directions. Thus, radio chatter is received by lots of devices that don't want to hear it. In a room with 100 laptops and several access points, only a few devices can transmit at the same time, which leads to the slowdown I was talking about. At some point in the future, space-division multiplexing, meaning that signals are sent in the general direction of their destination, should allow more devices to talk at once.

I'm really not sure why some govenments are easily persuaded to ban such an obvious public benefit, but perhaps certain cash cows are a factor. Although the main beneficiaries are obviously big businesses, govenments get a cut too. Harold Feld explains in his discussion of the selling of former TV spectrum in the 700MHz range:
"Now you would think that (a) if the incumbents—large and small—are accused of gaming the system, and (b) all the incumbents defend the rules, while all the non-incumbents argue for a rule change, that the FCC would believe its own Chief Economist rather than the very people accused of gaming the rules to their advantage. Ha ha. Instead, the FCC adopted an industry sponsored 'compromise' that they easily manipulated to achieve open bidding. With the predictable result that the incumbents blocked the DBS guys and any other real competitor (while rewarding the mid-sized carriers with needed licenses).

"Why? In part because this stuff is hard to understand and it's very difficult to buck the kind of political pressure the incumbents brought to bear. In part because a number of folks at the FCC stil think of mid-sized carriers and cable cos as 'competitors' rather than 'incumbents.' But, most importantly, because spectrum auctions are the crack cocaine of public policy. Faced with the threat that the major incumbents would refuse to play (as if they could let that spectrum fall into the hands of rivals) and that the AWS auction would not gross the promised billions, the FCC caved like a chocoholic at a Godiva's outlet."
I highly recommend his excellent discussion, even though the auction is not directly related to municipal Wi-Fi. It illustrates a way in which government, even in unelected bodies like the FCC, can be influenced by big, monopolistic business at the expense of the public.

Mind you, the former UHF TV spectrum would make an excellent basis for municipal Wi-Fi if the FCC and CRTC would only allow it. One article explains:
At lower frequencies -- like in the television band -- signals travel farther and can go through walls, trees and mountains. Opening up some of this spectrum would make Community Internet systems much faster and cheaper to deploy, allowing a new generation of broadband entrepreneurs to enter the market. The broadcasters are about to return a sizable chunk of spectrum as part of the digital television transition, a portion of which could be reserved for Community Internet if Congress [don't you mean the FCC?] doesn't auction it all off to the cell phone companies. Another option would be to reallocate vast, unused "white spaces" between TV channels for wireless broadband. Either way, more "unlicensed spectrum" is the key to making universal, super-fast broadband for $10 a month a reality.
When it comes to the opposition of elected bodies to municipal broadband, campaign contributions are an obvious thing to look at, as well as the general phenomenon that politicians tend to favor big businesses--the bigger, the better. The telcos are rightly terrified of municipal wi-fi, given how cheap it can be done compared to how much they charge, and so I'd expect them to be lobbying like mad. Indeed, a completely free service (paid for by taxes) is the cheapest kind of service to provide, since no billing system is required and no "tech police" need to be hired to defend the network against free-riding attempts. This would be efficient and cheap for consumers, and a boon for the economy. At the same time it may harm the telcos, which would only be able to make money on the internet backbone and on services that are better than whatever the municipal network offers.

On the bright side, while municipal wi-fi has reportedly been banned in 14 states, Harold Feld thinks that incumbent opposition is softening because they know they can't stop it. As evidence he notes that AT&T plans to build a "muni wifi" system in Springfield, Il--the strategy being that if you can't beat 'em, pretend to join 'em and see how much profit you can get under the circumstances.

One final thought (source):
Settles noted that, when put in perspective, building a WiFi network is not that expensive. City governments regularly shell out hundreds of millions of dollars to build sports arenas, ballparks, and stadiums, yet balk at the much smaller cost (usually measured in tens of millions of dollars) to build and maintain a WiFi network.

"When you come down to it, you’re not talking about a lot of money," Settles said of the cost to build a WiFi network.
Links:

Thursday, March 15, 2007

Microsoft's flip-flop on patents

For the past few years Microsoft has supported software patents, an annoying plague ... or at least a common cold ... in the software industry. The software industry gained no benefit in the 90s when software patents became popular; there are good reasons to think that the system is unfair and detrimental to the industry as a whole.

I had a faint hope that when Microsoft was hit with a $1.5 billion judgement for infringing on one of the MP3 patents (because Windows supports MP3 files), it might change its tune. No such luck. Ironically, as this article expains, Microsoft's original basis for using patents recognized the flaws in the system.

Tuesday, February 20, 2007

FOV

This blog isn't about games, but I'm allowed to go off-topic right?

I play a lot of first-person shooters and other 3D games and I'm surprised at how many games don't offer a field-of-view (FOV) control.

In real life we have peripheral vision but in games we generally don't. Games are designed for relatively small screens, and if they start to pack too much of the environment on one screen, it starts to look weird. So they don't. The in-game camera of a typical first-person shooter typically has a FOV between 70 and 90 degrees. FOV is usually mesured vertically, I think (it depends on the game), which means that the angle from the top of the screen to the bottom is 70 to 90 degrees.

Suppose you are standing in the corner of a large square room, and you look directly at the opposite corner of the room. Now, can you see all four walls? If the answer is yes, then your field-of-view is greater than 90 degrees horizontally. In real life you can. But in many games, you can't. Video games deprive you of your peripheral vision. (Here are some illustrative screenshots from Mass Effect 3.)

In our home we have a projector that puts a 8-foot image on our wall. It is truly sweet, and makes for an immersive game when you're sitting 5 feet away from the picture. But if the game doesn't give you peripheral vision, it's no fun. It feels like you're looking at the world through a telephoto lens. As Half-Life 2 players reported, an FOV that is too low for the screen can cause nausea. Meanwhile, an FOV that is too high looks odd (and might have the same effect). Typically, console games have an FOV closer to 70 (because the screen is expected to be far away) and PC games use an FOV closer to 90 (since you people put your eyeballs two feet away from the screen).

Luckily, many PC games (though few console games) allow you to tweak the FOV. In this entry I will record instructions for changing FOV in various games. I would prefer to focus on first-person shooters but feel free to add instructions for any game in the comments.

Call of Duty

In Call of Duty, I've heard you can change the FOV by using Notepad to add the following command to C:\Program Files\Call of Duty\Main\config.cfg before you start the game (replace X with the desired horizontal FOV):

seta cg_fov "X"

By the way, certain widescreen resolutions are only available by changing this file. Use a series of commands like the following to request the desired resolution (more information):

seta cg_fov "96.4183" seta r_mode "-1" seta r_customwidth "1280" seta r_customheight "768" seta com_introplayed "1"

Call of Duty 2
  1. Under the Options menu, enable the console
  2. During gameplay, press the ~ key
  3. Type "seta cg_fov X" (without the quotes, of course) and press Enter, where X is the FOV you want (e.g. 100)
Doom 3
  1. Open the console (Ctrl + Alt + ~)
  2. Type g_fov 100 (substitute 100 with your preferred value)
The FOV setting will be forgotten when you exit. To make it permanent, edit autoexec.cfg (see here). By the way: Doom 3 doesn't work in Windows Vista, argh!

Far Cry

Far Cry isn't designed for a custom FOV and it will switch back to the default FOV every time you zoom in & out with your gun or binoculars. Still, you might want to increase your FOV temporarily. I find that Far Cry's normal FOV works fine outdoors, but indoors you're better off with an FOV between 110 and 120.

As explained in a tweak guide, the first thing you have to do is enable devmode.
[Y]ou must go to your Far Cry game icon, right click on it and select Properties. In the Target box, insert a space after the last " mark and type "-Devmode" (without quotes). It should look something like this:

"C:\Program Files\UBISOFT\Crytek\Far Cry\Bin32\FarCry.exe" -Devmode

Click Apply and OK to close the Icon Properties box. The next time you run Far Cry from this icon it will begin in Developer Mode, which is essentially a cheat mode.
Once that's done, the simplest way to change the FOV is to type fov 110 from the in-game console (press ~ to reach it.) But since the game always tries to change it back, you might want a key to help you switch.

So do this:
  1. Pick a key that you will use to set your favorite FOV. I use "Q" because it is convenient (it replaces Lean Left, which isn't as useful as Lean Right), but if the key you pick is already used for something else, it [probably] won't work. So first, un-assign the key from within the game.
  2. Open C:\Program Files\Ubisoft\Crytek\Far Cry\DevMode.lua in Notepad.
  3. Add the following line to the top of the file:

    Input:BindCommandToKey("\\fov 110", "q", 1);

    Replace 110 with your desired fov and q with your desired key. If it worked, then you can press that key in-game to change your fov. With extra work you could maybe set up a key that cycles through two or more different settings, but I'm lazy to figure out how.
Half-Life 2

This game's default FOV is 75 which is a shame because this game can be very immersive with a higher setting. We like to use 115 or 120 on our big screen; normal people might like 95 or so.
  1. You are not allowed to change FOV at the beginning; I think you can change it after you meet Barney, pile stuff up by the window, drop down and go through the loading screen.
  2. From the menu, go Options > Keyboard > Advanced and enable the "developer console".
  3. Press ~ in-game.
  4. Type sv_cheats 1
  5. Type fov 100 (substitute 100 with your preferred value)
Valve decided FOV is a "cheat" so it doesn't work in online deathmatch games or in Counter-Strike.

Unreal Tournament
  1. Open the console (is it done with ~?)
  2. Type fov 100 (substitute 100 with your preferred value). This won't work in some servers but it works in single-player.
Unreal II: The Awakening
  1. Press ~ to reach the console
  2. Type BeMyMonkey to enable cheat mode
  3. Type fov 100 (substitute 100 with your preferred value)
  4. Press Esc to exit the console
Mass Effect 2 and Mass effect 3: click the links

Games that have no FOV control:
  • Halo
  • Call of Juarez (apparently)
  • F.E.A.R. has no FOV control, but if you use a widescreen resolution, you will have a somewhat greater FOV.
Many games that don't have a FOV control will at least have a higher FOV horizontally when you use a widescreen resolution. There is a website dedicated to widescreen gaming where you can learn more. Their master games list says "Hor +" in the "Screen Change" column if you'll be able to see more in a widescreen resolution (more of the scene is added on the left and right sides), or it'll say "Vert -" if you will actually see less (because the top and bottom of the scene are cut off). It's all explained here.

More games?

If you know how to change fov in other games or if there are other web sites that talk about this issue, please make a comment.

Sunday, February 11, 2007

Excess Copyright

I've written no posts in so long, it's embarrasing. How am I supposed to inform people about stuff unless I write about stuff? Anyway, if you're Canadian you might want to take a look at Excess Copyright, which covers the state of intellectual property law from a Canadian lawyer's perspective. Does that sound boring? IP law has important effects on modern life, and if you realize how important it is, you won't find it boring.

Theoretically.

On the other hand, I know how important my eternal salvation is, but I still nod off in church.

Monday, December 18, 2006

Idiot instructors

I've had some great instructors at the University of Calgary, but they're certainly in the minority.

When I wrote that The U of C Sucks, I really thought I was going to school at a particularly bad university. Yet on the internet I've been seeing a lot of discontent about the quality of post-secondary education throughout North America. Here's one example:
On the first day of class, she struggled for a full five minutes trying to turn on the computer...

...despite repeated help and instruction from others in the class, Gabrielle just couldn't get it right. She started ever page with a BODY tag instead of the proper HTML tag, and insisted that it made more sense that way because HTML was "the language" and not a part of "the code." Her "proof" of this was that, thanks to Internet Explorer's forgiving nature, the pages rendered just fine.

Gabrielle's grasp of "documents" versus "programs" was just as painfully embarrassing. After editing an HTML document, she'd always say, "OK, I'm now saving my HTML program and will run it in Internet Explorer." I won't even get into how much Gabrielle struggled with doing actual web development in PHP.

Now I suppose this story is one that can describe just about every struggling Computer Science student that will eventually change their major to Communications. There's only one difference: Gabrielle was not a student in the Web Development course. She taught it.
Now, perhaps the story itself is a fabrication. Or not. But what's interesting is the high degree to which those in the forum identified with the story. It's believable because it rings true. Some of the responses:

"Honestly, this sounds about par for the course for a Community College / Junior College instructor. I had a couple of real boneheads in the comp sci department -- and this was at a *silicon valley* JC -- supposedly one of the best in the country, at that."

"That's like every 4th CS teacher I've had."

"The year I was appointed to the faculty, I taught a 4th year, or maybe it was graduate level, independent study course on X programming because the prof (my boss) was over-extended. I was all of 18 or 19 at the time, had never programmed in X and wasn't the greatest C programmer in the world. He knew I'd figure it out (and I did), but it could have gone horribly wrong, too. And this was at a good school. I can easily imagine a lesser school having someone like Gabrielle teach a web class."

"I used to work as both a lecturer and as tech support at a pretty decent CS university, and honestly there were some staff there who made two short planks look like a computer (...). Typically they start our as students who cheat their way through an undergrad degree (...) and get hooked on the lazy academic lifestyle. [...] they come back for a postgrad degree, take a decade to get through a PhD and wind up with a vague understanding of one very narrow field of CS and absolutely no idea about any others. The universities themselves don't help because they are all about bringing in money from research, and that's the direction they push the staff. Teaching undergraduates is generally treated as an annoyance they have to do to satisfy government requirements to keep all the lurks and perks associated with being a university..."

"For my OS Theory class, they couldn't find anyone to teach it. So the first night, the CS Chair came in and explained that to us. The second night, we got our professor..."

Well, you can imagine where that last one is going. Yup, something's rotten in the state of our schools.

Why Qwerty, and What's Better?

If you're curious about where our standard keyboard layout came from, have a look at my paper about its history and what's better. I wrote it for a class, but I promise it's better than typical classwork.

Here is a mirror at Geocities. I wonder if it's time to start paying for web space...

Wednesday, December 06, 2006

Stealing Fair Use, Selling It Back to you

EFF sums up how Hollywood is using the U.S.'s crappy DMCA to prevent consumers from doing what would otherwise be legal:
"Apparently, Hollywood believes that you should have to re-purchase all your DVD movies a second time if you want to watch them on your iPod." That's what we said last week, commenting on the Paramount v. Load-N-Go lawsuit, in which Hollywood studios claimed that it is illegal to rip a DVD to put on a personal video player (PVP), even if you own the DVD.

Well, this week the other shoe dropped. According to an article in the New York Times:

"Customers who buy the physical DVD of Warner Brothers' 'Superman Returns' in a Wal-Mart store will have the option of downloading a digital copy of the film to their portable devices for $1.97, personal computer for $2.97, or both for $3.97."

So you buy the DVD, and if you want a copy on your PVP or computer, you have to pay a second time. Despite the fact that you bought the DVD, and you have a DVD drive in your computer that is perfectly capable of making a personal-use copy. Imagine if the record labels offered you this "deal" for every CD you bought -- pay us a few dollars extra, and you can have a copy for your iPod. And a few more dollars, if you want a copy on your computer, too! As LA Times reporter Jon Healey puts it in his blog: "So from the perspective of the studios and federal officials, consumers have to pay for the privilege of doing the sorts of things with DVDs that they're accustomed to doing with CDs (and LPs and cassettes)."

This latest bitter fruit from Hollywood is brought to you by the Digital Millennium Copyright Act (DMCA), which treats "protected" content (like the encrypted video on DVDs), differently from "unprotected" content (like every audio and video media format introduced before 1996). Thanks to the DMCA, Hollywood believes fair use personal-use copies simply do not exist when it comes to DVDs.

Let's hope Congressman Rick Boucher is listening and will reintroduce his DMCA reform bill first thing next year.

Friday, November 17, 2006

Asset vs. Colemak

So the designer of the Colemak keyboard layout and I have been going back and forth, him criticising my Asset layout and me improving it. I think I'm nearly at the point where I can improve it no more, and it looks like this:
I could get a small improvement by moving L and Y in order to get Y in a more comfortable spot, and to remove the same-finger contention for the common digraphs LO, OL and MY. In order not to cause new problems, I'd have to shuffle Y, L, U, J, P, and K. However, this would make only 11 letters match Qwerty, which in turn means it is less different from Colemak, which keeps 10 letters. Actually, I'm kind-of considering switching P and U, which would make 13 letters match Qwerty, but my digraph data indicates that same-finger typing would increase by 0.52%. On second thought, the tradeoff is insufficiently compelling; I'll leave things how they are.

In the choice between Asset and Colemak, I guess what it comes down to is how much Qwerty similarity is desired. Asset keeps 12 letters while Colemak keeps 10; and in total, my Nov. 13 redesign also keeps 20/26 letters on the same finger, whereas Colemak only keeps 15/26. Unfortunately, how important it is to keep keys on the same finger is purely a matter of opinion, because it would probably take a quite expensive study to tell for sure.

Now, Colemak and Asset have many similarities, the only major differences I can see being that (1) Asset is more similar to Qwerty, (2) Asset's Y key could be better placed, and (3) Asset has higher same-finger typing.

Colemak's designer, Shai Colemak says that "Asset has 100% more same-finger ratio compared Colemak." That could be true (evidence?), but I tried a corpus of several books at http://colemak.com/Compare and found that Colemak usually has under 2% same-finger typing, which implies under 4% for Asset. Now, if we assume digraphs typed with the same finger take twice as long to type as digraphs on different fingers (actually I think it's less than twice), then we would conclude that a Colemak typist could potentially type about 2% faster than an Asset typist.

So that's the trade-off. More similarity to Qwerty or 2% more speed. I guess we'll let the community decide. Mind you, Colemak has more followers so the conclusion is probably foregone. Anyway, I guess I should resubmit the new Asset…

It would be kind of nice if Shai and I could come to a compromise. For example, on Colemak's home row you see ARST:

If he switched R and S then S would be back in its Qwerty position, and the Ctrl+S (Save) shortcut would be preserved. My digraph data indicates that if R and S were switched, the amount of same-finger typing would increase by 0.22% (e.g. 1.92% instead of 1.70%), so one might expect typists that are 0.2% slower—no big deal, IMO. I guess he wouldn't think it worthwhile, since he has declared the layout "stable", but as I said on the forum… if he switches them, I'll drop out of the competition and replace my Asset page with a page that praises Colemak :)

Saturday, November 11, 2006

The Asset Keyboard

A while ago I designed an improved keyboard layout called Asset, which attempted to maximize similarity to Qwerty. Now I'm studying the history of keyboards for a school project, and I decided to update my design based on some advice from a guy named Scott. Scott informed me some time ago that he'd been using his own personal layout since 1992, which had a nearly identical home row to Asset. I took his advice and made a couple more tweaks too.

After making the new Asset keyboard I found out about a layout called Colemak, which led me to the "Million Dollar Keyboard" competition. In fact, it's nothing of the sort--the prize is sitting at around $250. Anyway, if anybody's reading this and likes the keyboard, and if I understand the poorly-designed rules correctly, then if you join Wikidot, you can vote for my design on 2006/12/28.

Firstly, they decided to use 2-round first-past-the-post runoff voting, which probably means they know very little about voting systems. The system they chose will not accurately measure the opinions of the voters. I would've probably recommended Range Voting, although if I were designing a system myself I'd probably use something a little more elaborate than standard systems. Secondly, leaving the polls open for only one day will exclude voters who either had something else to do that day, or were forgetful. Finally, now that many submissions have been made, it is clear that the submissions come in very different flavors:
  1. Designs that change the key layout from Qwerty to something else
  2. Designs that keep Qwerty, but rearrange extended keys or add new features
  3. Ergonomic keyboard designs
It doesn't really make sense to have only one winner out of all three categories, because for the most part, the designs in different categories could be combined (although categories 2 & 3 tend to conflict or overlap). For example, one could easily imagine an Asset Editor's Keyboard in the style of the Microsoft Natural Keyboard.

Monday, October 09, 2006

RIAA bullying: worse than I thought

I already knew that the RIAA routinely sues individual file sharers, P2P network companies, and any company that could be construed as aiding copyright infringement. But to my horror, they have also used very mafia-style tactics to "teach a lesson" to the entire technology industry. Lawrence Lessig explains in Free Culture (p.188-192):
[...I]nnovators who want to innovate in this space can safely innovate only if they have the sign-off from last generation's dominant industries. That lesson has been taught through a series of cases that were designed and executed to teach venture capitalists a lesson. That lesson—what former Napster CEO Hank Barry calls a “nuclear pall” that has fallen over the Valley—has been learned.

Consider one example to make the point [....]

In 1997, Michael Roberts launched a company called MP3.com. MP3.com was keen to remake the music business. Their goal was not just to facilitate new ways to get access to content. Their goal was also to facilitate new ways to create content. Unlike the major labels, MP3.com offered creators a venue to distribute their creativity, without demanding an exclusive engagement from the creators.

To make this system work, however, MP3.com needed a reliable way to recommend music to its users. The idea behind this alternative was to leverage the revealed preferences of music listeners to recommend new artists. If you like Lyle Lovett, you're likely to enjoy Bonnie Raitt. And so on.

This idea required a simple way to gather data about user preferences. MP3.com came up with an extraordinarily clever way to gather this preference data. In January 2000, the company launched a service called my.mp3.com. Using software provided by MP3.com, a user would sign into an account and then insert into her computer a CD. The software would identify the CD, and then give the user access to that content. So, for example, if you inserted a CD by Jill Sobule, then wherever you were—at work or at home—you could get access to that music once you signed into your account. The system was therefore a kind of music-lockbox.

No doubt some could use this system to illegally copy content. But that opportunity existed with or without MP3.com. The aim of the my.mp3.com service was to give users access to their own content, and as a by-product, by seeing the content they already owned, to discover the kind of content the users liked.

To make this system function, however, MP3.com needed to copy 50,000 CDs to a server. (In principle, it could have been the user who uploaded the music, but that would have taken a great deal of time, and would have produced a product of questionable quality.) It therefore purchased 50,000 CDs from a store, and started the process of making copies of those CDs. Again, it would not serve the content from those copies to anyone except those who authenticated that they had a copy of the CD they wanted to access. So while this was 50,000 copies, it was 50,000 copies directed at giving customers something they had already bought.

Nine days after MP3.com launched its service, the five major labels, headed by the RIAA, brought a lawsuit against MP3.com. MP3.com settled with four of the five. Nine months later, a federal judge found MP3.com to have been guilty of willful infringement with respect to the fifth. Applying the law as it is, the judge imposed a fine against MP3.com of $118 million. MP3.com then settled with the remaining plaintiff, Vivendi Universal, paying over $54 million. Vivendi purchased MP3.com just about a year later.

That part of the story I have told before. Now consider its conclusion. After Vivendi purchased MP3.com, Vivendi turned around and filed a malpractice lawsuit against the lawyers who had advised [mp3.com] that they had a good faith claim that the service they wanted to offer would be considered legal under copyright law. This lawsuit alleged that it should have been obvious that the courts would find this behavior illegal; therefore, this lawsuit sought to punish any lawyer who had dared to suggest that the law was less restrictive than the labels demanded.

The clear purpose of this lawsuit (which was settled for an unspecified amount shortly after the story was no longer covered in the press) was to send an unequivocal message to lawyers advising clients in this space: It is not just your clients who might suffer if the content industry directs its guns against them. It is also you. So those of you who believe the law should be less restrictive should realize that such a view of the law will cost you and your firm dearly.

This strategy is not just limited to the lawyers. In April 2003, Universal and EMI brought a lawsuit against Hummer Winblad, the venture capital firm (VC) that had funded Napster at a certain stage of its development, its cofounder ( John Hummer), and general partner (Hank Barry). The claim here, as well, was that the VC should have recognized the right of the content industry to control how the industry should develop. They should be held personally liable for funding a company whose business turned out to be beyond the law. Here again, the aim of the lawsuit is transparent: Any VC now recognizes that if you fund a company whose business is not approved of by the dinosaurs, you are at risk not just in the marketplace, but in the courtroom as well. Your investment buys you not only a company, it also buys you a lawsuit. So extreme has the environment become that even car manufacturers are afraid of technologies that touch content. In an article in Business 2.0, Rafe Needleman describes a discussion with BMW:

"I asked why, with all the storage capacity and computer power in the car, there was no way to play MP3 files. I was told that BMW engineers in Germany had rigged a new vehicle to play MP3s via the car's built-in sound system, but that the company's marketing and legal departments weren't comfortable with pushing this forward for release stateside. Even today, no new cars are sold in the United States with bona fide MP3 players. . . ."

This is the world of the mafia—filled with “your money or your life" offers, governed in the end not by courts but by the threats that the law empowers copyright holders to exercise. It is a system that will obviously and necessarily stifle new innovation. It is hard enough to start a company. It is impossibly hard if that company is constantly threatened by litigation.

The point is not that businesses should have a right to start illegal enterprises. The point is the definition of “illegal.” The law is a mess of uncertainty. We have no good way to know how it should apply to new technologies. Yet by reversing our tradition of judicial deference, and by embracing the astonishingly high penalties that copyright law imposes, that uncertainty now yields a reality which is far more conservative than is right. If the law imposed the death penalty for parking tickets, we'd not only have fewer parking tickets, we'd also have much less driving. The same principle applies to innovation. If innovation is constantly checked by this uncertain and unlimited liability, we will have much less vibrant innovation and much less creativity.

Interestingly, Lessig doesn't directly point a finger of blame at the RIAA in his book. Of course, it is our dysfunctional copyright laws that enable the RIAA's behavior, and this is his focus. Whereas the maximum fine for a doctor that amputates the wrong leg in an operation is $250,000, the maximum fine for each and every song you download illegally is $150,000. And so he continues:

[...] This wildly punitive system of regulation will systematically stifle creativity and innovation. It will protect some industries and some creators, but it will harm industry and creativity generally. Free market and free culture depend upon vibrant competition. Yet the effect of the law today is to stifle just this kind of competition. The effect is to produce an overregulated culture, just as the effect of too much control in the market is to produce an overregulated- regulated market.

The building of a permission culture, rather than a free culture, is the first important way in which the changes I have described will burden innovation. A permission culture means a lawyer's culture—a culture in which the ability to create requires a call to your lawyer. Again, I am not antilawyer, at least when they're kept in their proper place. I am certainly not antilaw. But our profession has lost the sense of its limits. And leaders in our profession have lost an appreciation of the high costs that our profession imposes upon others. The inefficiency of the law is an embarrassment to our tradition. And while I believe our profession should therefore do everything it can to make the law more efficient, it should at least do everything it can to limit the reach of the law where the law is not doing any good. The transaction costs buried within a permission culture are enough to bury a wide range of creativity. Someone needs to do a lot of justifying to justify that result.

While of course I agree fully that the law is out of whack, I also think it is wrong for companies to do evil, even if the law allows it. Just as there's something wrong with Nike using sweatshop labor, and something wrong with companies dumping toxic waste into a river, it is wrong, even evil, for RIAA to use the law as a weapon to punish grandmothers, 13-year-olds, mp3.com, venture capitalists, lawyers who don't share its interpretation of the law, and Jesse Jordan. For it is apparent that legality and morality are sometimes at odds in the modern world--especially when the RIAA itself has a hand in writing many of today's bills.

Oh, about Jesse Jordan. Lessig tells his story in Chapter 3:

In the fall of 2002, Jesse Jordan of Oceanside, New York, enrolled as a freshman at Rensselaer Polytechnic Institute, in Troy, New York. His major at RPI was information technology. Though he is not a programmer, in October Jesse decided to begin to tinker with search engine technology that was available on the RPI network.

[...]

RPI's computer network links students, faculty, and administration to one another. It also links RPI to the Internet. Not everything available on the RPI network is available on the Internet. [...] The idea of “intranet” search engines, search engines that search within the network of a particular institution, is to provide users of that institution with better access to material from that institution. Businesses do this all the time, enabling employees to have access to material that people outside the business can't get. Universities do it as well.

These engines are enabled by the network technology itself. Microsoft, for example, has a network file system that makes it very easy for search engines tuned to that network to query the system for information about the publicly (within that network) available content.

Jesse's search engine was built to take advantage of this technology. It used Microsoft's network file system to build an index of all the files available within the RPI network.

Jesse's wasn't the first search engine built for the RPI network. Indeed, his engine was a simple modification of engines that others had built. His single most important improvement over those engines was to fix a bug within the Microsoft file-sharing system that could cause a user's computer to crash. With the engines that existed before, if you tried to access a file through a Windows browser that was on a computer that was off-line, your computer could crash. Jesse modified the system a bit to fix that problem, by adding a button that a user could click to see if the machine holding the file was still on-line.

Jesse's engine went on-line in late October. Over the following six months, he continued to tweak it to improve its functionality. By March, the system was functioning quite well. Jesse had more than one million files in his directory, including every type of content that might be on users' computers.

Thus the index his search engine produced included pictures, which students could use to put on their own Web sites; copies of notes or research; copies of information pamphlets; movie clips that students might have created; university brochures—basically anything that users of the RPI network made available in a public folder of their computer.

But the index also included music files. In fact, one quarter of the files that Jesse's search engine listed were music files. But that means, of course, that three quarters were not, and—so that this point is absolutely clear—Jesse did nothing to induce people to put music files in their public folders. He did nothing to target the search engine to these files. He was a kid tinkering with a Google-like technology at a university where he was studying information science, and hence, tinkering was the aim. Unlike Google, or Microsoft, for that matter, he made no money from this tinkering; he was not connected to any business that would make any money from this experiment. He was a kid tinkering with technology in an environment where tinkering with technology was precisely what he was supposed to do.

On April 3, 2003, Jesse was contacted by the dean of students at RPI. The dean informed Jesse that the Recording Industry Association of America, the RIAA, would be filing a lawsuit against him and three other students whom he didn't even know, two of them at other universities. A few hours later, Jesse was served with papers from the suit. As he read these papers and watched the news reports about them, he was increasingly astonished.

“It was absurd,” he told me. “I don't think I did anything wrong. . . .

I don't think there's anything wrong with the search engine that I ran or . . . what I had done to it. I mean, I hadn't modified it in any way that promoted or enhanced the work of pirates. I just modified the search engine in a way that would make it easier to use”—again, a search engine, which Jesse had not himself built, using the Windows file- sharing system, which Jesse had not himself built, to enable members of the RPI community to get access to content, which Jesse had not himself created or posted, and the vast majority of which had nothing to do with music.

But the RIAA branded Jesse a pirate. They claimed he operated a network and had therefore “willfully” violated copyright laws. They demanded that he pay them the damages for his wrong. For cases of “willful infringement,” the Copyright Act specifies something lawyers call “statutory damages.” These damages permit a copyright owner to claim $150,000 per infringement. As the RIAA alleged more than one hundred specific copyright infringements, they therefore demanded that Jesse pay them at least $15,000,000.

Similar lawsuits were brought against three other students: one other student at RPI, one at Michigan Technical University, and one at Princeton. Their situations were similar to Jesse's. Though each case was different in detail, the bottom line in each was exactly the same: huge demands for “damages” that the RIAA claimed it was entitled to. If you added up the claims, these four lawsuits were asking courts in the United States to award the plaintiffs close to $100 billion—six times the total profit of the film industry in 2001.

Jesse called his parents. They were supportive but a bit frightened. An uncle was a lawyer. He began negotiations with the RIAA. They demanded to know how much money Jesse had. Jesse had saved $12,000 from summer jobs and other employment. They demanded $12,000 to dismiss the case.

The RIAA wanted Jesse to admit to doing something wrong. He refused. They wanted him to agree to an injunction that would essentially make it impossible for him to work in many fields of technology for the rest of his life. He refused. They made him understand that this process of being sued was not going to be pleasant. (As Jesse's father recounted to me, the chief lawyer on the case, Matt Oppenheimer, told Jesse, “You don't want to pay another visit to a dentist like me.”) And throughout, the RIAA insisted it would not settle the case until it took every penny Jesse had saved.

Jesse's family was outraged at these claims. They wanted to fight. But Jesse's uncle worked to educate the family about the nature of the American legal system. Jesse could fight the RIAA. He might even win. But the cost of fighting a lawsuit like this, Jesse was told, would be at least $250,000. If he won, he would not recover that money. If he won, he would have a piece of paper saying he had won, and a piece of paper saying he and his family were bankrupt.

So Jesse faced a mafia-like choice: $250,000 and a chance at winning, or $12,000 and a settlement.

The recording industry insists this is a matter of law and morality.

Let's put the law aside for a moment and think about the morality. Where is the morality in a lawsuit like this? What is the virtue in scapegoatism? The RIAA is an extraordinarily powerful lobby. The president of the RIAA is reported to make more than $1 million a year. Artists, on the other hand, are not well paid. The average recording artist makes $45,900. There are plenty of ways for the RIAA to affect and direct policy. So where is the morality in taking money from a student for running a search engine?

On June 23, Jesse wired his savings to the lawyer working for the RIAA. The case against him was then dismissed. And with this, this kid who had tinkered a computer into a $15 million lawsuit became an activist:

"I was definitely not an activist [before]. I never really meant to be an activist. . . . [But] I've been pushed into this. In no way did I ever foresee anything like this, but I think it's just completely absurd what the RIAA has done."

Jesse's parents betray a certain pride in their reluctant activist. As his father told me, Jesse “considers himself very conservative, and so do I. . . . He's not a tree hugger. . . . I think it's bizarre that they would pick on him. But he wants to let people know that they're sending the wrong message. And he wants to correct the record.”

We're glad to help you out, Jesse.

Just so this story has a happy ending, it is worth mentioning that the RIAA doesn't win every lawsuit. In 1998 they sued Diamond Multimedia for selling a portable MP3 player. The RIAA lost, allowing us to enjoy the iPod and other music players. Can you imagine how the world would look if they got everything they wanted? Or perhaps there is a more interesting question: what sorts of new technologies and businesses would exist if the law didn't side so eagerly with them? Until the law is changed, I suppose we'll never know.

P.S. While you can read Free Culture for free online, I highly recommend a paper copy.

Wednesday, October 04, 2006

The Usual Bush

Would it be too blunt to simply say that George Bush is a bad man? His political tactics are as disgusting as his contempt for freedom, fairness, privacy, the Geneva conventions and the constitution. I don't talk about Bush much on my blog, but maybe I should.

What amazes me is that so many Americans still don't mind. It seems like he can do anything at all and as long as he claims it will help "the war on terror", people will still support him. Now, I like to think that Bush's victory in 2004 was caused by the lousiness of the alternative, John Kerry. That's why I advocate electoral reform, so we can have more than two "real" choices. But when I see that 41% of voters "approve" of Bush's perfomance (or maybe 44%), my hope dwindles a little. Even though 55% disapprove (45% strongly), I wonder why the rest of the people don't see what he's up to.

And what is he up to know? Well, there's a bill (here's a data sheet) that has just passed that will kill Habeas Corpus for some detainees. Forget the flowery description on Bush's web site; as Human Rights Watch explained before the bill's passing:
In its immediate practical impact, the most damaging of the bill’s provisions is clearly its “court-stripping” provision, which would bar detainees in U.S. custody anywhere around the world from challenging the legality of their detention or their treatment via habeas corpus actions, even if they have been subjected to torture. Innocent people could be locked up forever, without ever having the facts of their case reviewed by an independent court.

If held to be constitutional, the court-stripping provision would result in more than 200 pending cases being ejected from the courts, including the case that resulted in the Supreme Court’s landmark detainee ruling in June.

...

The bill has other dangerous provisions as well. The latest version of the legislation includes an extremely dangerous expansion in the bill’s definition of “unlawful enemy combatant” – a phrase used by the administration to justify holding a combatant outside of the usual protections given to combatants by the Geneva Conventions. It now explicitly deems persons who have “purposefully and materially supported” hostilities against the United States to be combatants, an unprecedented redefinition of “combatant” that could potentially cover a range of innocent people. Financing and support for terrorist activities are already criminal offenses in the civilian justice system. This definition would pervert any reasonable concept of what a combatant is.
Indeed, there is no requirement that an "enemy combatant" actually be involved in combat, and since no proof is required to apply the label, there is no guarantee that he or she is an "enemy" at all. The bill also sounds subjective, allowing top officials to make up new policies:
Moreover, the provision also gives carte blanche to the Pentagon to call anyone an “unlawful enemy combatant.” All it requires is that the person be deemed an unlawful combatant by a Combatant Status Review Tribunal (the administrative bodies used at Guantánamo) or “another competent tribunal” established under presidential or military authority.

...

...the Secretary of Defense is to be delegated the power to create new rules and procedures if he or she considers the use of their courts-martial equivalents to be impracticable.
The only plus side in this bill is that Bush didn't get all he wanted:
The legislation rejects the Bush administration’s attempt to explicitly rewrite the humane treatment requirements of the Geneva Conventions and to decriminalize all interrogation practices short of torture. On “Face the Nation,” last Sunday, Senator John McCain made clear that practices such as waterboarding, extreme sleep deprivation and induced hypothermia will continue to be war crimes if the legislation is passed.

The bill does, however, narrow the scope of the War Crimes Act; it bars the Geneva Conventions from being invoked in any suit against the U.S. government, gives the president power to interpret “the meaning and application” of the Geneva Conventions, and prohibits the courts from relying on foreign or international law sources in deciding cases involving certain violations of Common Article 3 of the Geneva Conventions.
I wonder if the U.S. is so polarised that Bush supporters completely ignore what the opposition is saying, assuming that it's all lies intended to make Bush look bad. Indeed, some of the rhetoric against Bush goes too far, and maybe that turns people off. For example, maybe the first paragraph of this post goes too far. But after Bush has abused the world so much, it starts getting hard to restrain myself.

Related links:

Monday, October 02, 2006

About DRM

If you are interested in buying music, movies or TV shows online, it's important to know about so-called "Digital Rights Management" (DRM) and how it can affect you.

My best friend ran into trouble with DRM for the first time a few days ago. He was preparing a home movie about our vacation to Los Angeles and Mexico, so he tried to find mexican music online and found some at PureTracks (puretracks.com). Apparently I had done a terrible job teaching him about DRM, because he spent a long time listening to different tracks and then bought three songs--or more accurately, he paid for them. (If you are hip to copyright law, you know the difference.)

Of course, if he knew anything about DRM, he would've known that you can't simply put purchased music in a home movie. Free music, yes, pirated music, certainly--but if you pay for it, no. That's why opponents of DRM call it "Digital Restrictions Management" instead.

PureTracks, for its part, did not warn him of the DRM, or explain what it was, except in fine print. (I bet it also didn't explain, as this review of PureTracks does, that you can only download and listen to the tracks on Windows using Windows Media Player).

What is DRM?

In a nutshell, DRM refers to any technology whose sole purpose is to limit what you can do with digital media; usually it involves encryption. Encryption, in turn, is a mathematics-based method of preventing data from being understood by any piece of software that does not have the decryption key and the decryption algorithm. Only with all three items--the music file, the key and the decryption software--is it possible to listen to the music or do anything else with it, such as put it in a home movie or burn it to an audio CD. Ostensibly, DRM is intended to prevent piracy, but in practice many law-abiding consumers are prevented from exercising their rights.

When you buy music online from services like iTunes or (in our case) PureTracks, they are almost always encrypted with DRM. The decryption keys are always stored separately, often in a secret location, and in a file that may or may not itself be encrypted by a secondary key. The decryption software is tied to the media player; for example, the decryption algorithm for iTunes is built into iTunes, and the decryption algorithm for Windows Media Player is built into Windows Media Player. There is no technical reason for this; it is a business matter: Microsoft and Apple don't want to allow anyone else to use their algorithm.

You see, Apple has a near-monopoly on the business of selling music online, and it maintains this monopoly by having the only service (iTunes) that can put DRM'd music on an iPod. The music labels of the RIAA generally refuse to sell music without DRM; thus, as long as iPod remains the dominant music player (with 88% market share, by one estimate), Apple's monopoly is assured to continue. Microsoft is in a weaker position, and perhaps (just a guess) feels that by licencing their DRM algorithm to Apple, it would weaken their position further. Perhaps neither Apple nor Microsoft can safely reverse-engineer each other's algorithms, since doing so would risk lawsuits thanks to the DMCA and any software patents under which these algorithms are protected. RealNetworks reverse-engineered Apple's DRM, but Apple made a lot of angry noises.

But even if Microsoft and Apple were to licence the DRM algorithm to each other, they wouldn't let just anybody use the algorithms. No doubt anyone that wants to play with Microsoft or Apple would have to pay those companies and agree to strict terms-of-use that might preclude putting DRM'd music in a home movie. So when my friend tries to add his Mexican track to his DVD timeline, the DVD editor will forever respond:
Unable to open file [...]

File is protected by digital rights management (DRM).
DRM prevents you from doing everything that isn't explicitly allowed, which includes a lot of things. DRM is often sold with video, movies and e-books as well, but on the subject of music, the otherwise legal things you cannot do include
  • Making a backup copy of your music, or keeping a copy of your music on two of your own computers--well, actually you can do these things, but only with a method approved by Apple or Microsoft (for example, this page explains the method for iTunes). The naive method of simply making a copy of the files will not work. The scary part for Joe Consumer is that a backup may seem to work: when he makes a copy and plays it on the same computer, the music player may still be able to find the file on the hard drive that contains the decryption key. But when Joe's hard drive fails and he goes to restore the backup on a new one, the key is gone, and the files are worthless.
  • Putting the music on a music player that was not specifically designed and licenced to work with the DRM. For example, you can't put iTunes music on a non-iPod or put Microsoft DRM'd WMA music on any music player that doesn't have the Microsoft label "PlaysForSure".
  • Playing the music in the program you want. For example, if you bought some music from Apple and some WMA files from PureTracks, you would not be able to play both sets of music in the same program. As for me, I prefer to play music in WinAmp.
  • Playing the music in the operating system you want. In particular, neither Apple nor Microsoft provide a player for Linux (e.g. Ubuntu), which is popular among computer professionals and geeks everywhere.
  • Putting the music in a home movie for personal use.
  • Extracting short snippets for fair use purposes.
Escaping DRM

Generally, the only way to accomplish these legal activities is to get around the DRM. There are at least five ways to escape music DRM; the first method is the best way to avoid a slight degradation of the sound quality:
  1. Using a DRM cracking program. For example, for WMA files, there is a program called FairUse4WM that may be able to unlock purchased music. However, we tried it and for some reason it didn't work. By the way, there is reason to suspect that it is illegal to use this program in the U.S., thanks to the widely-hated DMCA.
  2. Microsoft and Apple provide one loophole to get around DRM: the ability to burn audio CDs. Audio tracks on audio CDs cannot contain DRM, so once you have the music on a CD, you can rip the CD to make MP3 files, which also do not contain DRM.
  3. The sound drivers on some Windows computers allow you to directly record what is being played on speakers. In Windows' Volume Control window, choose "Properties" from the "Options" menu and under "Adjust volume for", choose "Recording" and click OK. Now you can adjust the recording controls. I can't tell you what to do exactly because the controls differ from one sound system to another. Anyway, once it is set up, you can record what is playing from another program such as the Sound Recorder in the Start Menu under Programs | Accessories | Entertainment. If you use Sound Recorder, by the way, be aware that it records at an extremely low quality by default. To record at CD quality, select File | Properties, click Convert Now, and choose "CD quality" under "Name", then click OK and OK. You should use a better program for all but the shortest recording tasks; I just don't know what to recommend. By the way, I don't think this method will be possible in Windows Vista because of new "security" measures added to Vista by Microsoft (can someone confirm?)
  4. Use analog recording. For example, connect an audio cable from the speaker output of your computer into the line in of another device.
  5. Use a file-sharing program to get another copy of your music, this time in MP3 format. Remember, MP3 files do not suffer from DRM. This method may be illegal, but it may also be easier than tackling the DRM directly.
Technologies that use DRM (new section)

Entities that use DRM or other forms of content restriction include:
  • Online music stores, including iTunes
  • Online TV and movie stores, including iTunes
  • HD-DVD and Blu-ray, the upcoming high-definition video discs
  • DVDs, which are encrypted with a system called CSS. Although this system is relatively weak, the DMCA makes it illegal to break in the U.S. That's why, in the U.S., you can't buy a program from a store that can extracts parts of a DVD for fair use, or downsamples a DVD for backup on a CD or DVD-R; software that does such things is underground. Home movie DVDs, however, can be made without CSS, and software can legally handle such video.
  • TiVo: TiVo now restricts what you can do with some programming. By the way, TiVo has also used its software patent on a "multimedia time warping system" to reduce competition.
  • Satellite radio: as the result of negotiations with the RIAA, recording is severely restricted on satellite radio. Last time I checked, you cannot move the recordings off the device that did the recording.
Conclusion

DRM is a means of control--a means of taking freedom away from citizens. It can be circumvented, but only with analog methods, the CD-burning loophole, piracy, or tools that are banned under the 1998 United States Digital Millenium Copyright Act (DMCA). Only the CD-burning loophole and the analog methods are still legal (in the U.S.), and the content industries would like to "plug the analog hole" as well. As for CD burning, Microsoft and Apple have the power to limit that ability as they choose.

A lot of people, myself included, boycott DRM. Maybe you should too. But more importantly, tell everyone you know about DRM. Tell them how it can affect them. As an executive at Disney said to the Economist:
"If consumers even know there's a DRM, what it is, and how it works, we've already failed."
In addition, join me in opposing the DMCA, especially its anticircumvention provision, and new anti-consumer proposals such as the broadcast flag, the broadcast treaty, and the U.S.-instigated DMCA lookalike in Australia. The entertainment industry officially spent $55 million on lobbyists in 2005, so the fight is not easy, but without grassroots opposition, it is clear that major content owners will have their way.

But who knows? Maybe this copyfight will be a downhill battle.

Friday, September 22, 2006

WIPO's rediculous broadcasting treaty

For some time now WIPO, an organization whose sole intention seems to be expanding IP monopoly powers worldwide, has been trying to create a "broadcasting treaty" that would create an new set of intellectual property rights for "broadcasters", whether they operate on the airwaves, cable or the internet. These new rights, which are planned to last 50 years from the time of broadcast, appear to be separate from copyright and would operate in parallel to it. Personally, I can't even figure out what exactly WIPO wants to accomplish with these radical new broadcasting rights; it is not only public interest groups that oppose it, but also many large technology companies such as AT&T, Verizon, Sony, Intel, Dell, HP, and more. Of course, I suppose major broadcasters and Hollywood are in favor (if their silence is any clue).

WIPO is an unelected organization consisting of people whom the public knows nothing about, yet it is somehow empowered to write laws that the world has to follow. I find that pretty scary, and the history of their treatymaking is pretty scary too. Admittedly, part of my fear comes from the fact that I don't understand how it works and from whence its power comes. I would like to learn but I haven't found a very good source yet.

I don't see any way for individual citizens to influence WIPO, so all we can do is watch on the sidelines and hope they don't get their way. The EFF is doing what it can, of course, but NGOs don't have any real power and typically aren't allowed to speak at WIPO meetings. As EFF said about a meeting last week:
A large and diverse group of public interest organizations, artists, U.S telecommunications companies, consumer electronics companies, and related industry bodies turned up in force to oppose the current draft. Yet again, non-governmental organizations were not given an opportunity to present statements during the meeting. However, EFF distributed an open letter to WIPO signed by over 200 podcasters and podcasting organizations, together representing thousands of podcasters. The letter expressed podcasters' concerns that the treaty would increase complexity for rights clearance and harm the innovation environment for online communication technologies.
Anyway, I recommend reading EFF's page on the broadcasting treaty.

Saturday, September 16, 2006

AOL's search gaffe: not so bad?

If you haven't heard, somebody at AOL released three months of web search records for roughly 1.5% of U.S. users that use AOL's client software. In the aftermath, AOL officially apologized and followed that up with the firing of three staff members including the Chief Technology Officer. Despite this, criticism of AOL continues, with the EFF leading the complaints.

Now usually I agree completely with the EFF, but in this case I'm not so sure. In the first place, each searcher is associated with a random ID number, so most searchers are impossible to identify--so far as I have seen, only one person has been identified by a third party. In the second place, AOL has been so thoroughly flogged that I don't think they will ever try it again.

And that's my point. Much has been made of the danger of releasing search records--sometimes people search for their own name, or personal info such as their Social Security Number whose presence online they only want to detect, not create. And, of course, there's the chilling effect that could be caused by people's fear that they might be watched. I'm sure there are other reasons too.

But as AOL says, their intention--or the intention of those who were fired, presumably--was to give academic researchers real-world data to analyze, so that researchers could look for patterns in the data and see what sort of thing real users search for. This is interesting stuff, both to provide us with shock-and-awe stories of sickos online (for example, this and this), and to satisfy our curiosity about what other people search for.

The nice thing about the AOL scandal is that none of those whose searches were revealed knew that their queries would be recorded and broadcast. This obviously makes it a serious privacy incursion, but it also ensures that the searches were completely honest, not constrained or biased by privacy worries.

The fact is, this search information can tell us things that we simply cannot learn any other way. So I, for one, will be genuinely interested to see what sort of observations academics will make from this data (if they dare).

But now that this data is available, I guess we don't really need any more. This data is valuable because of its uniqueness, but a second data leak wouldn't have the same novelty. So if some other dumb search engine decides to take a data dump, that's when I'll consider unleashing my wrath.

Ticket cancelled!

My best friend decided to send my blog post about my transit ticket to the Calgary Transit Authority. At first they responded basically by saying "well, you could have bought next month's pass up to ten days in advance" and suggested I should show up in court to plead my case before a judge. Well, personally I don't think I should have to do that--I think it should not be their policy to give fines on the first of the month. I have never been charged with anything before and would not feel comfortable in court... especially since the fact remains that I'm technically guilty of the charge, notwithstanding that it is probably a mistake made by many.

Anyway, to my surprise I got a phone call from a "Transit Constable" who said that the ticket was given in error, and that they were cancelling it. Wow! This is a wonderful surprise. By the way, since getting the ticket I've had my fare checked 3 times, which proves they aren't singling out people who have an expired pass on the 1st of the month.

Friday, September 15, 2006

Dictionary (should be) up

Finally, internet access.