If all this is true – there’s no way of telling yet – Groq could very well pose a threat to Nvidia’s dominance. Ross is careful in discussing this issue. “Let’s be clear – they are the Goliaths and we are the Davids,” he said. “It would be very, very foolish to say Nvidia is worried about us.” Still, Nvidia’s quick response when asked about Groq suggested the startup was indeed on its radar. Goliath’s PR team sent me a statement with near-Groq speed indicating that Nvidia’s AI advantage lies not just in its chips but also in the other services it provides customers. Like AI software, memory, networking, and other goodies. “AI computing in data centers is a complex challenge that requires full-stack solutions,” it said, meaning its unnamed rivals may face stack challenges.
Regardless, Ross said he’s not competing with Nvidia, but rather providing another experience, and not just in terms of speed. His mission is to ensure that Groq delivers fair results that are not influenced by pressure from political views or commercial interests. “Groq will never get into the advertising business,” he said. “Because this affects people. AI should always be neutral, it should never tell you what you should be thinking. Groq exists to make sure everyone has access. It helps you make your decisions, not it decision.” Great sentiment, but even the Groq chatbot was skeptical of that claim when I asked it about its early idealism. “The pressure to generate profits and scale can lead even well-intentioned founders to compromise their ideals,” the company responded immediately.
another thing. You may have heard that Elon Musk named the LL.M. created by his artificial intelligence company “Grok.” This surprised Ross because he said he trademarked the company’s name when he founded it in 2016 and thought it covered the phonetically identical original term. “We called Dibbs,” he said. “He can’t own it. We’ve sent a cease-and-desist letter.” So far, he has not received a response from Musk.
When I asked Groq about the name dispute, it first warned me that it does not provide legal advice. “However, I can provide some background information to help you better understand the situation,” it said.This bot explains the term Gronk It’s been used in the industry for decades, so Musk has every right to use it. On the other hand, if Groq trademarked the term, it would likely have exclusive rights. Everything is accurate and to the point – everything you would expect from a modern LLM. What you didn’t expect was that you received a reply in less than a second.
time travel
In my book about Google, “In the Plex,” I explain how the company and its co-founder Larry Page prioritized speed, recognizing that faster products were not only used more frequently, And the way of using it is also different. It became an obsession within Google.
Engineers working for Page quickly learned [his speed] Priorities. “When people do presentations, they’re very slow and I’ve been known to count sometimes,” he said. “One thousand, two thousand. That tends to get people’s attention.” In fact, if your product can complete the measurement in a few seconds, you have failed. Paul Buchheit remembers a time when he was in Larry’s office doing an early Gmail demo. Page made a face and told him it was too slow. Buchheit objected, but Page reiterated his complaint, charging that reloading takes at least 600 milliseconds. (That’s six tenths of a second.) You couldn’t know that, Buchheit thought, but when he returned to his office, he checked the server logs. Six hundred milliseconds. “He succeeded,” Buchheit said.