- x NeonPulse | Future Blueprint
- Posts
- 🤖 Meta hits the scene
Good morning and welcome to the latest edition of neonpulse!
Here's what we have for you today:
Meta hits the scene
Copyright protections
And the $10,000 chip powering the future
Meta introduces LLaMA
While Google and OpenAI have been focusing on consumer-facing A.I. products, Meta has gone in a different direction, releasing a large language model intended for research use by universities, NGO’s, and industry labs.
“Today we’re releasing a new state-of-the-art AI large language model called LLaMA designed to help researchers advance their work,” Zuckerberg said in a Facebook post.
“LLMs have shown a lot of promise in generating text, having conversations, summarizing written material, and more complicated tasks like solving math theorems or predicting protein structures. Meta is committed to this open model of research and we’ll make our new model available to the AI research community.”
And according to Meta’s research paper the LLaMA model is no slouch, with tests showing the LLama-13B model significantly outperforming ChatGPT-3 on most benchmarks despite being “10x smaller.”
What makes this feat even more impressive is that Meta was able to accomplish this performance using a single GPU, meaning that there’s a high probability that LLaMA models could be run on consumer-level hardware in the near future.
"I'm now thinking that we will be running language models with a sizable portion of the capabilities of ChatGPT on our own (top of the range) mobile phones and laptops within a year or two," wrote AI researcher Simon Willison.
Meta also went in a dramatically different direction than other A.I. companies by training the model on publicly available datasets, including Wikipedia and Common Crawl, introducing the possibility that the technology could become open source.
"Unlike Chinchilla, PaLM, or GPT-3, we only use datasets publicly available, making our work compatible with open-sourcing and reproducible, while most existing models rely on data which is either not publicly available or undocumented," tweeted project member Guillaume Lample.
In regards to how LLaMA will impact the future of Meta, with the amount of money Zuckerberg has lit on fire in the pursuit of the Metaverse (which no one seems to want but him) I’m sure stockholders are eagerly awaiting the moment he explains exactly how LLaMA is going to make them money.
No copyrights for A.I.
Earlier this week the U.S. copyright office has ruled against the protection of A.I. generated works, including art, writing, and music, a decision that was made in response to a copyright application for a graphic novel which contained artwork produced by Midjourney.
A.I. artwork from “Zarya of the Dawn”
In the letter to the applicant, officials said that the decision was focused on whether or not the artwork was produced with “human authorship.”
“As stated in the Compendium of U.S. Copyright Office Practices (3d ed. 2021), the Office will not register works produced by a machine or mere mechanical intervention from a human author. The crucial question is ‘whether the ‘work’ is basically one of human authorship, with the computer [or other device] merely being an assisting instrument, or whether the traditional elements of authorship in the work (literary, artistic, or musical expression or elements of selection, arrangement, etc.) were actually conceived and executed not by man but by a machine,” wrote the Copyright office.
And while Kashtanova claimed direct involvement in the creation of the A.I. artwork through her prompt selection, the Copyright Office did not agree, stating “the fact that Midjourney’s specific output cannot be predicted by users makes Midjourney different for copyright purposes than other tools used by artists.”
Yet this ruling may have created a significant loophole where artists continue to apply for copyright protection for their works, simply choosing to not disclose the fact that the work was created with the help of A.I.
You can check out the full Copyright Office decision here.
The $10,000 chip
As companies battle for A.I. dominance, a single piece of hardware has become the critical backbone of the industry: the Nvidia A100 chip.
The A100 chip has become the workhorse of the A.I. industry, with Nvidia taking 95% of the market for machine learning graphics processors according to New Street Research.
Originally created to render videogame graphics, the A100 is able to perform many calculations simultaneously, making it the perfect chip for the neural network and machine learning models powering tools like ChatGPT, BingAI, and Stable Diffusion.
The largest A.I. companies require thousands of A100 chips to power their models, making the A100 chips so synonomous with A.I. that analysts have started to use the number of A100 chips a company has as a gauge for their potential future success.
A100 chip counts
Nvidia is benefiting massively from the rapid adoption of A.I., with the stock jumping 14% after their earnings report this week based largely on the increase in demand for A.I. chips.
“The activity around the AI infrastructure that we built has just gone through the roof in the last 60 days,” said Nvidia CEO Jensen Huang during the earnings call this week.
Traders that entered into short dated call option positions prior to earnings were up close to 600%, making this one of the best trades of the year.
You can learn more in the “State of AI” compute index report here.
Brought to you by Jasper
If you have to write a lot for work, whether its marketing copy, social media posts, or marketing emails, there are a number of great A.I. tools that allow you to create powerful copy in a flash.
I think the best way to describe Jasper is that it’s like kryptonite for writers block, helping me to turn out high quality content with perfect grammar in an instant.
If you don’t have to write a lot for work it’s not a must have, but if have to produce content regularly, and frequently find yourself staring at a blank screen praying for inspiration, its definitely worth checking out.
If you’d like to take Jasper for a test drive, neonpulse readers can get 10,000 free credits by clicking here.
And now your moment of zen
That’s all for today folks!
If you’re enjoying Neon Pulse, we would really appreciate it if you would consider sharing our newsletter with a friend by sending them this link:
And if you’re looking for past newsletters, you can find them all here.