LLMs

Goldman Sachs CIO says "there’s a great opportunity for capital to move towards the application layer, the toolset layer. I think we will see that shift happening..."

"Builders are creatives, if you unlock their creative power; empower them to compose with API services, new architectures… infinite possibilities emerge."

But Bug Bounty platform HackerOne isn't too worried that LLM-generated bug reports will become a deluge...

"No serious user-facing product will display GPT-4-generated output given its legal issues that will continue and become even more serious throughout 2024; new architectures competing with Transformer, such as Mamba, will appear..."

"Administrators can also configure allowed topics and blocked topics and words so that the responses are controlled. In addition, administrators can enable or disable the upload file feature for their end users..."

Altman was "not consistently candid in his communications with the board, hindering its ability to exercise its responsibilities. The board no longer has confidence in his ability to continue leading OpenAI.”

OpenAI has pushed out a flurry of updates at its first developer conference – including the release of its new GPT-4 Turbo which can fit the “equivalent of more than 300 pages of text in a single prompt” – and the ability to train and run LLMs powered by proprietary datasets. Calling

The investment comes as a Google DeepMind paper poured some cold water on the AI hype, finding "various failure modes of transformers and degradation of their generalization for even simple extrapolation tasks" if these are out of its training data domain.

"Cache misses have this weird massive non-linear effect into how much work the GPUs are doing, because we suddenly need to start recomputing all this stuff."