Categories
quotes ranting

The A.I. Bubble and Life-Changing Use Cases

A.I. can write book reviews no one reads of A.I. novels no one buys, generate playlists no one listens to of A.I. songs no one hears, and create A.I. images no one looks at for websites no one visits.

This seems to be the future A.I. promises. Endless content generated by robots, enjoyed by no one, clogging up everything, and wasting everyone’s time.

Lincoln Michel, in The Year that A.I Came for Culture [newreplublic.com], published in The New Republic

Will A.I. turn the internet into a virtual version of the Earth in Wall-E? Abandoned under so much garbage we have to evacuate? Some army of little A.I.’s left behind to cleanup the shit —to correct the hallucinations, remove the copyright infringing generated images and text?

Maybe not. 2023 was the year of A.I.. It’s been building for some time, with AI/ML being a term discussed endlessly at work for a few years. But in 2023, with the launch of ChatGPT (actually in November 2022 with GPT 3.5), A.I. went from something on the periphery of everyday life —something you heard about in passing news stories about tech— to an inescapable monster, on the lips of everyone, from tech CEOs to cultural commentators. A.I. managed to hold our collective attention in a way few things can in our hyperactive zeitgeist.

I don’t agree with everything Lincoln Michel discuses in the New Republic article but there was a line that caught my eye:

A.I. costs lots of money, and once investors stop subsidizing its use, A.I.—or at least quality A.I.—may prove cost-prohibitive for most tasks.

This caught my eye because I just read an article by Cory Doctorow the other day in Locus. In Cory Doctorow: What Kind of Bubble is AI [locusmag.com] Doctorow addresses the the same idea, that the cost of A.I. is it’s Achilles heel:

The universe of low-stakes, high-dollar applications for AI is so small that I can’t think of anything that belongs in it.

Basically Doctorow says that A.I. is unlikely to be able to fully replace a human for high-stakes applications —think doctors. A.I. can help speed up the process but do you trust an A.I. to make a life-or-death medical decision without human review? And if the A.I. is augmenting the human and not replacing it the economics don’t seem to work given the cost of running the most advanced A.I. models.

Of course A.I. is still getting better. So maybe in a few years it will get to the point that we all trust it to make life-or-death decisions for us without a “human in the loop”. Maybe people born after the LLM revolution will grow up just trusting A.I. more than those born before.

A.I. researches are looking at how to bring the cost down without sacrificing the quality of their models. Apple is working on models that will run on an iPhone rather than whole data centers. After all, technologies march to shrink it’s size and power consumption while increasing it’s power is incredible:

In 1978, the Cray 1 supercomputer cost $7 Million, weighed 10,500 pounds and had a 115 kilowatt power supply. It was, by far, the fastest computer in the world. The Raspberry Pi costs around $70 (CPU board, case, power supply, SD card), weighs a few ounces, uses a 5 watt power supply and is more than 4.5 times faster than the Cray 1.

Roy Longbottom, in Cray 1 Supercomputer Performance Comparisons With Home Computers Phones and Tablets [roylongbottom.org.uk]

How long will it take today’s data center sized A.I. models to run in my pocket or on my wrist? And by then will the data center sized models be trustworthy enough to handle the high-stakes —fault intolerant—, high-dollar applications?

Who knows. I’ll leave predicting to future to the Sci-Fi authors like Doctorow.

But, I think Doctorow’s point is good; the current hype around A.I. is a bubble. What will be left when it bursts? Will, as Lincoln Michel wonders, A.I. technology plateau as so many other technology promises have, forever just a few years away?

I’m personally skeptical of truly life changing things coming from the current bubble, small incremental improvements, sure, endless annoying low-stakes use cases, absolutely, but truly life changing? I remain skeptical.

Though, the ability for ChatGPT to answer all your homework problems will force education to change, but schools adapted to pocket calculator and then graphing calculators, they will adapt to A.I. bots in the kids pockets too.

It should also be noted that the current hype cycle is over Generative A.I., which is only one branch of A.I.. Some life changing A.I. applications are already out there, like IBM’s A.I. for folding proteins. I think this is the kind of A.I. that will truly change the world in the long run, helping scientists to push medicine forward rather than spitting out clickbate content to game the online advertising world.

Categories
photography travel

Strasburg & Colmar, France, December 2022

I posted photos from my 2022 trip to Paris almost a year after the trip, just at the end of September. I had intended to post about the other part of that trip, to Strasburg and Colmar, soon after and definitely before this years trip.

I failed.

So, here it is, almost the end of 2023 and I’m posting a link to my photos from the 2022 trip to Strasburg and Colmar. More than a year after the trip. Sad. I hope to do better.

In any case, my family and I spent five days in Strasburg as a break from Paris. We spend most days wondering around the old Alsatian part of town, visiting the Christmas Markets.

Between glasses of vin chaud, the local mulled wine, or hot apple cider, we browsed the market stalls and climbed to the top of the Strasburg Cathedral. And we spend a day in Colmar, checking out their markets and drinking vin chaud there.

While Paris was all about visiting museums and churches, something to do every day, Strasburg was for sleeping in and relaxing, no scheduled ticket times.

Oh, and we waked to Germany. We took the tram to the closest stop and then walked over the Pont de l’Europe, crossing the Rhine and into Germany just far enough to catch the tram back. Just to say we did it.

IMG_2717
Rose window of Strasburg Cathedral

You can see the few photos I took, mostly of the buildings and especially the cathedral in the Strasburg, France, 2022 Photoset on Flickr [flickr.com].

Categories
quotes

Odds & Ends

A collection of quotes I’ve stumbled across and wanted to write something about or share but never finished a proper post. Collected here with half finished or no commentary…


I have the most devoted and ardent of friends, and affectionate relatives — and of enemies I really make no account.

Walt Whitman, in a letter to a German friend on his sixty fourth birthday

Words to live by? Contrast with “keep your friends close but your enemies closer,” from The Godfather Part II.


Fluidity of memory and a capacity to forget is perhaps the most haunting trait of our species.

Wade Davis in The Unraveling of America [rollingstone.com], published in Rolling Stone

The whole article is worth reading, depressing as it is. But if Americans don’t start to internalize the decline of America and its ideals, replaced as they have become by quick and catchy political slogans and dogma packaged as identity then nothing will change and America is doomed as an idea if not a country.

Someone once told me that the founding documents of America, the. Declaration of Independence, the Federalist Papers, and the Constitution with the Bill of Rights, are some of the most enlightened and important documents in the history of humanity and human thought. A bit of hyperbole but point taken. He also said that America’s history is an ongoing experiment to see if humanity can live up to such lofty ideals. It took us “four score and seven years” to even begin to live up to the first line of the Declaration, that “all men are create equal” and as we approach 250 years we are still struggling with that one.

Progress has been slow and fitful, but there has been progress. But somehow there is always a significant number of Americans that fall back on their tribalism and unite in their fear of the other. It’s a sad irony that those who publicly shout about the greatness and sanctity of the Constitution are the ones who seem to be the furthest for living up to ideals on which it is based.


In competitive athletics you play the best you can on that day, and sometimes you lose and sometimes you win. It is best to not be overly attached to the final result if you want to play your best…

Richard Geib, posted in “Mushin” – A Legacy to My Daughter [rjgeib.com] on rjgeib.com

[W]e judge the sophistication of our peers by how sophisticated they are with use of language. Your smartest friends can use deadpan sarcasm, and your smartest friends can get it when you’re deadpanning sarcasm

Stanley Dubinsky, quoted in “The Dad-Joke Doctrine” [theatlantic.com], pubished by The Atlantic

The article is from 2018 but it showed up in a list of Fathers Day related articles this year. It’s interesting giving some theories on why the dad joke exists, how there is analogous ‘traditions’ in some other cultures and languages. Serious lack of dad jokes in the article through. And the few they do give just re-enforce the “dad-jokes = bad-jokes” stereotype.

Anyway, it’s not the dad jokes that this quote is about, it’s about the use of complex linguistics like sarcasm, or puns. I love sarcasm and puns. But living in Singapore I think a lot of my sarcasm and puns go over most peoples heads. To the point that I use a lot less of them than I used to, though sometimes I can’t help myself, the immediate response or comment to a what someone says just comes out without conscious thought, it has to for it to work, if you wait five minutes to make a sarcastic remark or come up with a pun as part of your response then there is no point.

The issue is mostly because English is not most people’s first or primary language. Even when it is the primary language for a lot of Singaporeans, taught in school as the main language, the proficiency and vocabulary is not strong enough to handle more complex puns and sarcasm. There is just too high a proportion of non-native speakers you talk to in daily life, daily interactions demand simpler language. People just don’t use puns and sarcasm so much.

I feel like many snappy retorts and come-backs are lost on most people I speak with, they just don’t immediately get the joke.


My mother is very religious so I’m very much aware of the attitude that these are the last days. But, let’s face it, no matter where we have been in history, whoever has existed has been living in the last days… their own. When each of us dies the world ends for us.

Octavia E. Butler, in Octavia E. Butler: The Last Interview and Other Conversations

I’ve never read Octavia Butler, always on the list, never at the top. But I like this quote I found in a post on The Marginalian [themarginalian.org].


Expressing oneself in the world and creativity are the same. It may not be possible to know who you are without somehow expressing it.

Rick Ruben, in The Creative Act

I’ve always had to desire to create, but never the drive to truly create. I play at it but I don’t put in the hours to be a truly creative person.

For example, I’ve been doing photography for more than 25 years, but I’ve never tried to truly learn to be a photographer. I never took a class or read a book. I’ve googled my way to solving specific problems or copying a cool effect I see. I’ve absorbed a lot of lingo and I can control my camera fairly well. Even enough to master full manual mode.

I use Lightroom to clean up my photo. And it comes with photoshop but I’ve rarely opened photoshop. The closest to creativity with images I get is using Adobe’s Express to make the featured images on my posts. I am happy with most of those, especially the ones I did for my series of posts covering my best mobile photos [confusion.cc] year by year since 2004.

Categories
albums

Flood

Artist
They Might be Giants
Relaese Date
January 15, 1990

Flood [discogs] by They Might be Giants [discogs] may be the greatest alternative, indie, college rock album ever. TMBG might be known as comedy music, joke rock to most people, not serious music, but fans know that the music is as good as any mainstream rock band, the lyrics are —far from being jokes— often complex and meaningful, they have a lighter side but they are not just jokes. Also two of the songs on Flood had faux music videos on Tiny Toon Adventures [wikipedia.org] in early 1991, and I definitely remember watching those on Fox after school.

Due to the Tiny Toons videos I think Flood was a the gateway to TMBG for many people my age, much too young to have been in the core college fan demographic of the time. But Flood was not my gateway to TMBG. I do remember watching the videos for “Istanbul (Not Constantinople)” [youtube.com] and “Particle Man” [youtube.com] on Tiny Toons —much later I found there was an “official” video for Istanbul [youtube.com]. But in 1991 I had just turned 13 and it was not a good time in my life, According to Wikipedia the Tiny Toons episode containing Istanbul” and “Particle” Man aired in February 1991… right in the middle of the Gulf War, or Operation Desert Storm, and my mom was serving. She was not in the Middle East, she was a reservist and was called up in late 1991 to replace the active duty people who were deployed to the Middle East. But my mom was away from home all the time stationed several hours away, and I did not get along with my dad. So, the whole period of late 1990 to late 1991 while she was on active duty was not a good time in my house.

Anyway, it was a couple of years later that I got into TMBG. My (re)introduction was via a couple of friends in high school: S████ and G████. S████ especially used to listen to them all the time, Apollo 18 [discogs.com] and John Henry [discogs.com] were more recent and I recall he listened to them more, but Flood was in the mix. And it was the album that made the biggest impression on me. It was the first TMBG album I bought for myself. It was in the little CD wallet I kept in my backpack in senior year, along with other albums that are or will be on this list of my favorite: Under the Table and Dreaming [confusion.cc], and Garbage for two examples.

As for the music, Flood is an eclectic album like all TMBG albums. Besides “Istanbul” and “Particle Man”, both excellent songs, my three favorite would be: “Birdhouse In Your Soul”, “We Want a Rock”, and “Your Racist Friend”. “Your Racist Friend” in particular is one of the first political songs I really listened to, getting in to the politically charged music of Rage Against the Machine about the same time, late in senior your of high school when Evil Empire was released. It also has to be said that “Minimum Wage” is a brilliant… song? I’m not sure it counts as a song, jingle I guess.

I will admit that the first half of the album holds my attention better than the second half. But, I still listen to Flood from start to finish regularly.

But take a listen for yourself, on Apple:

Or on Spotify:

Categories
quotes ranting

The Artists and the AIs

Would I forbid the teaching (if that is the word) of my stories to computers? Not even if I could. I might as well be King Canute, forbidding the tide to come in. Or a Luddite trying to stop industrial progress by hammering a steam loom to pieces.

Stephen King, from Stephen King: My Books Were Used to Train AI [theatlantic.com] published by The Atlantic.

I read that back in August and it’s stuck with me. I’ve had several conversations about this topic with various people. There are a lot of people out there who are railing against the use of their work in training AI. Screaming everything from plagiarism to copyright infrengement.

On the one hand I can understand the fear and anger. If you spend your time to create something and you hope to make your living from that creation and subsequent creations that may depend on consumers liking your style… then the idea that your style can be mimicked, cheaply and quickly, by an AI is an existential threat.

But, here’s the thing. Is an silicon-and-copper AI, trained on the works of any artist, living or dead, copyrighted material or not, and then asked to mimic the style of said artist, any different than a flesh-and-blood artist who spends time studying the works of another artist to mimic the style because they like it or because people will buy works in that style? I’m not sure I see a significant difference.

I remember spending hours in the art museums in DC and London and seeing artists sitting there with their notebooks or, sometimes, even an easel setup copying the works. They would sketch or paint in full or in part, a copy of a work hanging in the museum. They were literally copying the work of another artist. I assume they were learning.

Of course these studies can’t be sold, I guess, if the original work is still in copyright. If the original work is out of copyright, in the public domain, the then anyone can sell a copy. There is a whole industry creating copies of famous paintings, as accurately as possible, to sell to people (or companies) who want a copy. Check out this story about the village in China that turns out endless copies of famous paintings: On the Ground: Van Gogh lives here. So does Rembrandt. A Chinese village where the great masters live on (in replication) [latimes.com]. But copies for selling aren’t my point; copying for the sake of learning, of training the artist to be able to reproduce the style or incorporate the style into their own works is the point.

There is a whole industry of artist out there creating works that are “in the style of”. See this story on the work or a Disney artist who did Star Wars in the style of Calvin and Hobbes [theverge.com], I love it, I love both Star Wars and Calvin and Hobbes and as this falls under the rules I parody, I’m total down to buy a tee shirt of this. Or, go search Etsy, Redbubble, or DeviantArt for “Calvin and Hobbes” for examples of artists drawing the famous duo in all manner of styles. Or search DeviantArt for “Studio Ghibli” and see the plethora of works that are either characters or scenes from Studio Ghibli works done in other styles or the works of others done in the style of Ghibli Studio.

If our art is popular people on the internet are going to mimic it. And a lot of them are going to sell it.

All of this is to say that training an artist —a physical human or a digital AI— on existing art is fine. Copyright rules are supposed to protect the ability of the original artist to make a living while allowing others to produce derivative works (copyright has many issues, including abuse by individuals and corporations to stifle legitimate derivative works just because they have the money to hire better lawyers, but that is beyond the scope of this post, my point is there is a system). If I ask an AI to write me a story in the style of Steven King and it is not literally reproducing large swaths of text from King’s works then how is that different from anyone inspired by Steven King writing stories? Remember what Picasso Bansky said: Good artists copy. Great artists steal.

IMG_8216

I recently saw a post of AI created “Disney Princesses in the style of Studio Ghibli” making the rounds on social media. That’s an old trope, what’s new is that they did it with AI, the output was good, and they used that output to create a YouTube video, with AI voice over, that they could post and make money on ads.

And I think his issue of not paying someone to create the art, but going cheap on an AI so that they can make more profit by pushing out more content to social media is the real issue. In the end the issue is that commerce trumps creativity; and if you are trying to make a living from your creativity commerce and the AI is going to destroy you.

The ease and speed with which the AI can pump out the Disney-Ghibli princesses means more profit for the person who posts the video than if they had to pay an actual artist to do the work. It’s the age old issue of capitalism valuing art only in so far as it makes money. Profitability trumps artistic vision. Nothing new there. Artists will need to adapt, it’s never been an easy living, and throwing their sabots at the AIs won’t stop it.

The more industry is able to use AI to replace actual human creativity the more our culture will suffer. Art, in all its forms, more than anything else is what makes us human. Since the first humans pressed their hands to a rock and spit ochre to leave their mark art has been a defining characteristic of humanity. It would be a great pity if the AI drove human artists to extinction.

I have purchased a fair bit of actual art from internet artists over the years. I have a cabinet full of posters, books and figurines by various creators: A Lesson is Learned by the Damage is Irreversible [alessonislearned.com], Josh Cooley and Gaping Void [gapingvoid.com] (which the artist seems to have turned into a successful consulting business, but they were selling prints of their art back in 2010), ARt from these three is in the featured image of this post, as long ago I downloaded images of what I bought to create a layout for my wall, but I never got them up. I’ve also supported Dresden Codak [dresdencodak.com], Little Gamers [little-gamers.com], CHAKAL666, Steve Bailik, and many more. Most seem to be offline these days. I wish I had room to display all the art I have, but most of it is in a boxes or poster tubes.

Would I buy AI art? I don’t know, right now I don’t see anything that I think is so amazing and honestly the money is going to who? Most AI art seems to be clickbait. Prompt engineering is a skill, just go and take a look at the prompts that are being used to generate images with Midjourny or Dall-E. The people generating good AI art are working at it, though it might not be compariable to the work of an artists who spent years developing the muscle memory and eye for painting.

Anyway, support culture, support artists. Buy art from people. But, avoid things that are obvious copyright violations. Parody is your friend.