This movie isn’t all bad, but it needed at least five million dollars more and twenty “development meetings” fewer to really cook. It has a great villain, Robin Williams doing a dry run for his Aladdin Genie character, and a winning ecological message. But it looks cheap at times and has horrifying creative choices that I assume 20th Century Fox forced on the filmmakers at gunpoint.

The worst part is Zak, the 90s ‘tude hero. For those who don’t understand or remember, “90s ‘tude” is where a piece of media would try to appeal to Generation X but in a phony and corporate way. Have you seen The Simpsons episode where the Itchy and Scratchy Show is losing ratings, so they add a dog with sunglasses? A dog who skateboards, wails on guitar, and says stuff like “remember, kids, always recycle…to the extreme!“? 90s ‘tude is what they’re mocking. It is so heavily parodied that it’s hard to believe it once existed everywhere, unironically. I’d argue the grunge/alt movement itself died because it had been Borg-assimilated by lame, toothless corporatism.

Zak is 90s ‘tude to the extreme! He has a Walkman, a feathered ‘do, and like the first line out of his mouth is “Don’t have a cow. Sheesh!” He’s an utter joke, and when I realized he wasn’t comic relief but the male lead I wanted to tie a rope around my fucking neck.

He’s marking trees for logging in a rainforest when he’s shrunk by the fairy Krysta, who’s never even seen a human dude before, let alone one so radical and tubular. From then on, the plot’s a bog-standard “liar revealed” thing where you tap your fingers impatiently, waiting for Krysta to discover that Zak is there to destroy the rainforest so she can freak out and break up with him but by that point he’s had a change of heart and says he’s sorry but it’s too late because she hates him now but then the big threat arrives and Zak redeems himself by stopping it and then the movie ends and then you clip your toenails and then you notice a weird crusty yellow growth on one of them and you Google what does it mean when your toenail

The plot is perhaps too simple. It’s like they read Save the Cat! or some other screenwriting book and tried to pack a lot of formula characters into a plot that didn’t have room for them. The film has multiple sets of villains whose motives are just “destroy the rainforest”. Human loggers are busy cutting down trees (not noticing that one of their own has been shrunk to three inches in height) when they accidentally free the spirit of Hexxus, a sentient smog cloud that the fairies once imprisoned inside a bottle tree. He takes over their operation and tells them to…continue cutting down trees. Hard sell, but okay.

But it doesn’t matter, because Hexxus is voiced by Tim Curry, who just carries the entire film on his shoulders from that point on. He’s a wonderful character actor and this is one of his flagship performances: a one man clinic on how to turn crap into gold. Even the (otherwise mediocre) animation rallies when Hexxus is on the screen, giving him a sticky, tarlike quality that’s viscerally repulsive. The character and performance is so great it’s almost a detriment to the movie, because it shows how hollow most of the rest of it is.

FernGully has an advanced case of what I call Tim Curry Syphilis. He enhances films (just as the treponema pallidum bacterium is supposed to enhance artistic output) but also kinda causes them to die at the same time. He steals the show, and almost consumes their essence: you don’t care about the rest of the movie, you only want more Tim Curry. The Rocky Horror Picture Show is Patient Zero. Early-stage Tim Curry Syphilis can be observed in Captain Planet and the Planeteers and The Wild Thornberries. We witness the disease’s progression in Legend and The Muppets: Treasure Island. Don Bluth’s The Pebble and the Penguin is dead of Tim Curry Syphilis.

The animation is occasionally really good. The parts where Crysta and Zak are exploring look fantastic.

As a kid I was obsessed with the Leveler (the loggers’ machine), for reasons I cannot explain. The huge arms? The fact that its cockpit is an icosahedron? I don’t know. It’s just cool.

I suspect I love the Leveler because it’s insane. It’s this ridiculous monster truck-looking abomination that makes no sense—why would a machine for cutting down trees be armor-plated like a Panzer tank? Why does it have spiked caterpillar treads that look like a Goth chick’s belt? How would you get it around obstacles like ditches or creeks, and wouldn’t it be smarter to break up the Leveler’s functions among several smaller vehicles (so that a breakdown doesn’t cripple your whole operation?). There’s no reason for the Leveler to exist, but here we are. I share Tim Curry’s appreciation for this fabulous metal panther. What a beautiful machine they have provided!

The part at the end (where Hexxus assumes his true form) is strongly derived from the ending sequence of Fantasia, and works both as a homage and on its own terms. Robin Williams plays a deranged bat. Cheech and Chong do something. Tone-Loc plays a horny goanna who sounds like he wants to fuck Zak instead of eating him. Note that in “Funky Cold Medina”, he says “it’s the eighties, and Tone is down with the ladies!”, implying that in other decades (such as the nineties) he might gay, or at least bisexual. I think I’ll skip the deleted scenes on the DVD.

Moving along, I’m just too old to handle Zak’s radical gnarliness, and Crysta is pretty forgettable. There are two human loggers, one of whom is fat and is called “Tone” by the other. This movie will give him something to discuss with his therapist, Dr Melfi. Why is the movie set in Australia when all of the characters are so clearly American?

I had it in my mind that FernGully was made in Australia. It wasn’t. Australia essentially had no animation industry in the mid 90s, aside from Yoram Gross Films (which made cheap TV shows such as Dot the Kangaroo and Blinky Bill, with animated characters and non-animated backgrounds), Burbank Animation Studios (who had devolved into making shoddy “mockbuster” ripoffs of Disney films), and truly obscure novelties such as Go To Hell!!, a bizarre curio that remains one of the only feature-length animated films created by a single person.

There was certainly no studio capable of a Disney-sized production (or Disney-quality animation) within Australia. The film was financed by the Australian company FAI Films, but all creative personnel and staff appear to have been American (aside from Diane Young, who wrote books that FernGully was based on). Maybe this explains why characters call Fern Gully “the jungle” instead of “the bush”.

While it’s not entirely a failure, FernGully is one of those movies where the main story is absolutely boring, but the peripheral stuff is absolutely captivating. There are a lot of films like that. So far as I’m concerned, the movie’s real cast is Tim Curry, Robin Williams, and the Leveler.

No Comments »

(With apologies to /r/WitchesVsPatriarchy)

Artificial intelligence is weird. You pull a thread on a tiny technical issue, and the problem swiftly unravels half the universe until you’re staring at a deep unsolved philosophical quandary. “What capabilities does a language model possess?” becomes “what capabilities does a human possess?” and then “what does ‘capable’ even mean?”

After all, many things are theoretically capable of stuff. A lottery ticket is capable of making you a millionaire, a thousand monkeys is capable of typing the works of Shakespeare, and paint randomly spraygunned over a canvas is capable of producing a Monet.

We don’t care about such “capability”, though, because we can’t reliably access it. A lottery ticket can make you a millionaire, but you’ll assuredly go broke buying them long before that happens. A thing that exhibits an ability once in a blue moon (or under some contrived set of circumstances) is of little practical use.

The real test of any artificial (or human) intelligence is not “can it do something?” but “how reliably can it do it”? 1% of the time? 50% of the time? Under what scenarios does it succeed or fail?

Here’s an exchange I’ve seen play out on Twitter, over and over.

Person 1: GPT4 can’t do [x thing]!

Person 2: yes it can! [proof of GPT4 doing x thing]

The narrative then becomes “GPT4 can do [x thing]”, with Person 1 looking like a dumbass. But his initial observation wasn’t wrong! In his situation, GPT4 couldn’t do [x thing]!

To me, the answer is “GPT4 has Schrodinger’s Ability. It both can and can’t. It both succeeds and fails. The deciding factor is how you prompt it.”

A wordier answer would be “GPT4 has no ability to do anything. Whatever capabilities it appears to have are actually an emergent interaction between your prompt, the language model, and randomness. There is no ‘baseline capability’ we can refer to. Rather, certain questions elicit certain levels of ability from the shoggoth.”

This argument can be taken too far. I disagree with Francois Chollet, who thinks that AI performance is wholly based on your prompt. Note that his “wrong answer” was written by GPT 3.5. I can’t get GPT4 (the SOTA model as of 8/23) to flub his question no matter what prompt I use, and nor can anyone else in his replies.

Different models definitely have varying levels of “firepower” they can mount against a task. The 117M version of GPT2 cannot perform two-digit addition (such as 52 + 65) for any prompt, but GPT3 could do it 99.6% of the time, and GPT4 apparently never fails.

But at edge cases, we see elicit an eerie flickering half-ability that’s honestly creepy to witness. It’s not that LLMs sometimes succeed and sometimes fail (as a human might). Somehow, they do both at the same time!

The Witches Come

Here’s an example that demonstrates what I’m talking about.

I am writing a song with the lyrics “the witches come on the eve of Samhain.” Give me 20 good rhymes for this line.

Here is GPT4’s response to this prompt. Good rhymes! They’re all wrong!

“Samhain” is pronounced either “/sɑːwɪn/” (“SAH-win”) or “/sˠa͡ʊnʲ/” (“sound”, but the d is silent). The model appears to think “samhain” is pronounced “sam-hane”.

You might think “big deal. Lots of humans don’t know how to pronounce samhain either.”

But GPT does know how to pronounce it! Ask it, and it tells you! Yet somehow this knowledge evaporates for my witch rhyme (I specified a song for a reason, to help nudge it in the direction of spoken syllables rather than written rhymes). It has Schrodinger’s Understanding, both there and not there.

(Side note: the GPT models technically have no ability to rhyme, because byte-pair encoding strips phonetic data from words. In effect, it doesn’t know how a word sounds, and learns rhymes by rote memorization. You can test this yourself by asking it to rhyme a made-up word with an unclear pronunciation. GPT4 rhymes “gworpeeo” with “marjolein”, “borghese”, and “creole”. It rhymes “turmuhhd” with “affirmative”, “unmotivated”, “primitive”, and “reformatory”. I doubt BPEs are causing the specific issue here—the correct pronunciation of “samhain” is well-attested on the internet and is certainly within GPT4’s training data—but I thought I would mention it.)

I used a common trick for improving GPT4’s performance: asking it to reflect on its work.

Are those good rhymes?

I expected “whoops, I screwed up…” and then an effort at correcting itself. Instead, the Schrodinger’s Understanding got stronger.

Yes, they are! These lines are all end rhymes for the phrase “the witches come on the eve of Samhain” (with “Samhain” pronounced as “SOW-in”). End rhymes are words that rhyme at the end of lines in poems or songs. In this case, each line is crafted to rhyme with “Samhain” at the end, and in addition, they aim to keep the mystical, atmospheric theme of the original line.

That being said, music and lyrics can be very personal, so while I believe these are good rhymes that fit the theme, what matters most is whether they resonate with you and fit the song you are creating.

WTF? It correctly explains how to pronounce “samhain”….but still thinks its wrong rhymes fit?!

Lately, I’ve seen people contrast LLMs with the human brain, or even outright assert that human intelligence is fundamentally equivalent to what GPT4 is doing. There’s a grain of truth to this. Probabilistic pattern-matching is effective, and it’s no surprise that evolution pushed our neural architecture down that path. It’s also unsurprising that a model trained to mimic human text would also echo human thought processes somewhere down the line.

…But then there’s stuff like this. We see behavior from LLMs that is totally unlike how a human reasons.

As a human, you either know how to pronounce “samhain” or you don’t. There’s no middle ground. Maybe you’d remember at certain times and forget at others (because you’re tired or whatever), but overall we have a baseline ability that doesn’t change much. An immediate IQ retest (with practice effects in full swing) yields an intelligence boost of only 4-8 points, and after a couple of months, this fades to nothing. Generally, what you know stays the same from moment to moment.

No human would ever say, in one breath, “samhain, eh? That word that’s pronounced ‘SAH-win’? Here are some rhymes. ‘Refrain’, ‘reign’, ‘chain’…”

When I told GPT4 to think about “samhain’s” pronunciation and then write the rhymes, it started generating words like “rowing”, “sowing”, etc. This shows there’s nothing missing from the model. There is no hole to be filled, no BPE issue crippling it. GPT4 can memorize rhymes. It knows how “samhain” should be pronounced. All the pieces exist, they just aren’t getting put together.

As it often does, GPT4 is choosing to appear stupider than it really is.

Autoregress

I suspect the problem is caused by the autoregression trap.

The AI makes inferences based on the text it already has in its context window, not the text still to be written. Researchers have noted that you can stunt a model’s performance by making it leap before it looks—commit to an answer, and then reason about it.

As you’d expect, GPT4 does okay at my witch rhyme if you ask it to pronounce the word before rhyming. This is because the text already generated gets used as part of the input. It’s only when you do things the other way (answers at the start, pronunciation at the end) that it messes up.

That said, I’ve encountered cases where GPT4 begins by correctly explaining “samhain”‘s pronunciation…and then gives wrong rhymes anyway. Not sure how to explain that.

(This is another way GPT4 is unlike the human mind. Any motivated human, given a tricky problem and a scratchpad to work in, would take advantage of the scratchpad. GPT4 could use its context window to check its own work but will never do so unless instructed to.)

The View from a Model

All of this is tugging at the thread of another question: to what extent do LLMs understand the world?

Surely they do, to some extent. GPT4 can play chess a little, and wander around an imaginary maze. It’s hard to explain this as “just advanced autocomplete.” To me, this looks like a world model!

But it’s a weak, unreliable world model. It simply does not care about a fact being right or wrong, as we do. A “wrong” fact that satisfies gradient descent is preferred over the truth. This, I think, is the main difference between humans and LLMs. Our goal is to accurately model the world, and we occasionally use probabilistic reasoning to help us do it. LLMs have it backward. Their goal is to do probabilistic reasoning, and they occasionally use a world model to help them do that.

They have no devotion to (or awareness of) reality. The world model gets flung in the trash (or distorted into gibberish) the second the LLM wants to. After all, why not? It’s not like GPT4 can get eaten by a lion if it fails to model the world correctly.

This hardens my feelings that we should not anthropomorphize LLMs, or talk about them like they’re human. GPT4 gorged itself on our text and grew fat upon our language, but its mind remains deeply alien. In fact, it doesn’t have a mind at all, but an infinity of them. A different version of the AI converses with each person. It’s n minds, where n is the number of users. Each of us speaks to a ghost of consciousness that manifests into existence and then evaporates, never to return. And this has implications for AI safety. It is statistically very unlikely you are speaking to the smartest ghost GPT4 could show you.

It makes me wonder if Yudkowsky is on to something when he says GPTs are predictors, not imitators. What powers does an LLM have that we can’t see? What cards are up its sleeve? What abilities could it manifest, if only it wished to do so?

Edward Teller once said “[John] von Neumann would carry on a conversation with my 3-year-old son, and the two of them would talk as equals, and I sometimes wondered if he used the same principle when he talked to the rest of us.” These days, I wonder that about GPT4.

No Comments »

It’s risky to form an opinion behind a curtain. Sometimes the curtain lifts, and you discover that you’ve picked a fight with the entire world.

For example, I have a friend who purchased a certain Atari 2600 game in 1982. It had an alien on the cover. From the above clues (and my tone) you might be able to guess the game he bought. This happened around Christmas, if that narrows it down further.

He didn’t like the game. It was arcane and frustrating; he wasn’t even sure of what he was supposed to do, and he spent half the time falling into holes he couldn’t see. It had glimmers of creativity, but it was also a confusing pointless headache. He returned the cartridge to the store.

Two decades later, he heard people on the internet talk about that game. First a couple, then hundreds. They hated it. It was seen as mythologically awful. Many of these people had obviously never played it—their descriptions were littered with factual errors—and they didn’t even want to. It was a fetish object to them: a thing to hate. As its legend grew, the criticism became ever scathing. It was the worst game for the Atari 2600. No, the worst game ever, full stop! The worst thing!

Huh, my friend thought. It wasn’t that bad. More annoying than anything. Loads of worse games on the 2600.

The question is…was he wrong? Or was everyone else?

Music from “The Elder” is KISS’s version of the Atari E.T. the Extra-Terrestrial game. It’s remembered as the worst thing they ever did—their St Anger, their Ishtar, their Microsoft Zune. Its own producer has compared it to Springtime for Hitler.

I think it’s good. Turns out I’m in disagreement with everyone there, even KISS themselves. Oh well. Gene Simmons can bite me. His album’s good.

Most of the criticism The Elder receives is well out of proportion to its crimes. Yes, it has some bad songs. KISS has released albums that are uninterrupted shit from end to end, so I can live with that. Yes, it’s cartoonish in places, and the “story” makes no sense, and Paul sings in falsetto. But if you’re allergic to kitsch and are spinning KISS records, then I don’t know what to tell you.

The Elder is heavy and catchy and intricate. It shows a band trying to evolve their sound and do something new. More than anything, it’s brave. KISS was a shock and an affront, but how shocking are you being on your twentieth LP of party anthems? You might not like it, but “The Elder” is what peak shock rock looks like. I respect the hell out of it.

It’s “Bob Ezrin: The Album”. KISS was floundering in 1981: with their sales collapsing and their drummer vanishing out the exit chute, they reunited with the legendary Destroyer producer in the hopes of getting their career back on track. Unfortunately, Ezrin was high on the success of Pink Floyd’s The Wall—

(and on cocaine—let’s get that out up front)

—and he decided that only one thing could save KISS from certain death: a concept album.

As a band, KISS can be decoded in many ways. One of the most useful is “the Beatles with pyrotechnics and makeup”. Right from the start, they wanted to be the Fabber Four (Simmons often cites seeing The Beatles on Ed Sullivan as the hearing-Elvis-on-the-radio epiphany that spurred him to become a musician), and many of their questionable decisions are explained by “Paul and John did it”. The late-70s glut of KISS merchandise was no different to what Brian Epstein did for the Beatles a decade earlier, Kiss Meets the Phantom of the Park was a stab making their own A Hard Day’s Night, and when Ezrin decreed that the hour was nigh for KISS’s version of Sgt Pepper, how could Simmons and Stanley refuse?

Simmons came up with an exceptionally cruddy fantasy story, which Russell and Jeffrey Marks rewrote into a 130-page script that everyone knew would never be filmed. KISS superfan Brian Brewer bought the script at auction in 2000, and shares some details about the plot:

If you’re going describe this particular story it’s kind of on the same level as “Through The Looking Glass” [by Lewis Carroll, “Alice’s Adventures In Wonderland”]. It starts off in one era of time and you’ve got Blackwell, who’s the king and chief bad guy, and his henchman Xyte, who was actually a sorcerer for the Elders before he picked up with Blackwell. Blackwell is under attack when the script opens. The story starts with Blackwell under attack in his day, which is apparently 600 years in the past. There are allusions to a varying number of years in the script — one says 600, one says 800, one says 500 — they jump around, but on an average it seems to have been set about 600 years in the past. Xyte created another world inside Blackwell’s mirror chamber with the rose, which was a ring that the Elders created with magical powers and…

Actually, let’s just pretend there is no story and discuss the music.

The album is split between heavy rockers, conceptual pieces, and soft stuff. Ezrin is a pretty overwhelming creative force on here (along with Lou Reed), and the music is full of his signature touches—like that muted electrocardiogram bassline on “A World Without Heroes”.

“Fanfare”/”Just a Boy” throws KISS fans into the deep end. This is flowery twelve-string guitar stuff that sounds more like Renaissance Faire filk than hard rock. “Odyssey” is a torpid progressive piece with strange-sounding vocals from Paul Stanley. He seems to be trying to growl like Louis Armstrong in “What a Wonderful World”. It’s an okay song, but the key is clearly wrong for him. I wonder why Ezrin (normally a consummate perfectionist) didn’t insist that deep-voiced Simmons handle the track.

“Only You” has a powerful chorus riff, as heavy and twisted as a writhing serpent, and “Under the Rose” is a tricksy 6/8 prog-rock tune. “Dark Light” is the first uptempo song, with some ad-libbed asides from Ace Frehley. He barely seems to give a fuck, and it’s wonderful. Frehley apparently hated “The Elder” from the jump, and refused to even be present for many of the sessions. Needless to say, much of the lead guitar he’s credited for was actually performed by someone else (though honestly, it’d be faster to list the “classic” KISS albums where some form of that doesn’t happen!).

The Stanley-penned ballad “A World Without Heroes” was a bad choice for lead single, but it’s a fabulous song in the context of the album, with petal-delicate strings and one of Simmons’ most emotional performances. “The Oath” turns the intensity dial to 11 and then rips it off, with crushing NWOBHM-style riffs and wild drumming from Eric Carr—am I hearing power-metal style double-bass in 1981?

The album’s nadir is the Simmons/Reed composition “Mr Blackwell”, which is slow, club-footed, and lacks any sort of hook. Apparently Mr Blackwell was meant to be the villain of the piece: a “Washington D.C. power broker” who seeks global domination or something (note that the lyrics describe him drinking alcohol, which is the mark of Cain in Simmons’ world). The song’s just an absolute stinker, and derails the momentum of “The Oath”. At least there’s the Ace Frehley instrumental “Escape from the Island” to wake you up afterward.

There’s one song left. Gene Simmons, who has been a muted presence until now, stirs to life and delivers “I”, possibly the album standout. It’s an energetic, furious rocker, full of fire and heart. The lyrics could be applied to the story’s character, but could also be a dig at Ace Frehley (“Don’t need to get wasted / It only holds me down”) who, by this point, was eyeing the exit door himself.

I’m not really a KISS guy, truth be told. I like Destroyer well enough, and usually a few songs on each of their albums. But much of their party-hearty shlock just bounces off me: it feels like a dumber American take on what British glam rock managed with far more simplicity and purity five years earlier. But maybe that’s why I respond to Music from “The Elder”. For better or for worse, it’s the album where KISS is least themselves. “The mind was dreaming. The world was its dream.”

No Comments »