Google Translate: The Ideas Behind Neural Translation
A simplified illustration of common techniques. Not an exact map of Google Translate’s current system.
Top 6 Techniques to Make Your AI System Efficient
Serving LLMs at scale is expensive. These 6 popular techniques reduce latency and cost, and make your system more efficient.
Watch an ex-YouTube engineer rebuild YouTube in 45 minutes.
By the end it's running:
- Home feed
- Video upload to the cloud
- Video playback from the cloud
- Data in a real database
- Search, using multimodal embeddings
- Deployed to a real URL
All of those explained in under
Watch an ex-YouTube engineer rebuild YouTube in 45 minutes.
By the end it's running:
- Home feed
- Video upload to the cloud
- Video playback from the cloud
- Data in a real database
- Search, using multimodal embeddings
- Deployed to a real URL
All of those explained in under an hour.
Jev is TypeSafe AI's first System One Model.
It is 100x faster and cheaper than frontier LLMs.
That opens up a lot of use cases people usually skip because the big models are too slow or too expensive for them.
Here are 9 use cases where we think Jev could be used instead of an LLM.
@zahanm and I sat down with the ByteByteGo team for a deep dive on the GPT-Live system. It's nicely illustrated and gets into a few details that we weren't able to cover in our previous GPT-Live blog post. Check it out!
GPT-Live is the most natural, conversational voice model we've tried.
Under the hood, it pairs a new generation of voice model architecture with a serving system built for low latency.
To understand how it all works end to end, we sat down with two engineers on the GPT Voice team: Zahan Malkani and Justin Uberti (the creator of WebRTC).
In our deep dive, you'll learn:
- The three generations of voice systems: cascaded pipelines, turn-based end-to-end models, and full-duplex models
- Why separating thinking from talking is the core idea behind GPT-Live
- The engineering behind the serving system, including the live and async paths
- How evaluation differs for full-duplex voice systems
- Lessons for building realtime systems, and what's next for voice
🚀 Announcing ByteByteGo Live: learn AI live from real builders.
I’ve spent the past 8 years on education: thousands of hours writing books, deep dive newsletters, YouTube, etc.
Two issues I keep seeing are: 1) it’s very different to learn from real builders. 2) most online courses never get finished (~4% completion).
Over the past 12 months, we’ve been working on what we can do to change that.
Today, I’m excited to announce ByteByteGo Live: live cohort courses taught by real builders.
- Taught by real builders. Our instructors include very senior engineers from Google, Meta, etc., as well as @KentBeck , the creator of TDD. They teach what they use in their own work.
- Live cohorts. Every course runs live with a group of people, and instructors answer your questions in real time.
The current lineup:
- AI Engineering Fundamentals
- Build with Claude Code
- Build Production Grade AI Systems
- Rebuild YouTube with AI
- AI Evals in Practice
- AI Cost Optimization
- Trust-optimized AI Development
We have big plans for the year ahead: more courses, more instructors, and deeper hands on projects.
Check out go.bytebytego.com/live-launch-x and let us know what you think.
Visualizing a SQL query in 5 mins
SQL statements are executed by the database system in several steps, including:
- Parsing the SQL statement and checking its validity
- Transforming the SQL into an internal representation, such as relational algebra
- Optimizing the internal representation and creating an execution plan that utilizes index information
- Executing the plan and returning the results
295K Followers 610 FollowingCo-Founder of ByteByteGo | Author of the bestselling book series: ‘System Design Interview’ | YouTube: https://t.co/9gPSJSrtPU
6 Followers 303 FollowingLa conoscenza rende un uomo inadatto a essere uno schiavo.
— Frederick Douglass |
Learning the value of real Money #Bitcoin | FOSS Lover ❤️
19 Followers 2K FollowingDad | Husband | Ethical Hacking | “Time is what determines security. With enough time, nothing is unhackable”, Aniekee Tochukwu Ezekiel
0 Followers 21 FollowingCloud security engineer | Founder BitlockShield
I lock down IT for dental & medical practices so ransomware and password chaos stop being your problem.
295K Followers 610 FollowingCo-Founder of ByteByteGo | Author of the bestselling book series: ‘System Design Interview’ | YouTube: https://t.co/9gPSJSrtPU