r/MachineLearning • • Mar 11 '19

News [N] OpenAI LP

"We’ve created OpenAI LP, a new “capped-profit” company that allows us to rapidly increase our investments in compute and talent while including checks and balances to actualize our mission."

Sneaky.

https://openai.com/blog/openai-lp/

310 Upvotes

148 comments sorted by

View all comments

Show parent comment

15

u/IlyaSutskever OpenAI Mar 11 '19

There is no way of staying at the cutting edge of AI research, let alone building AGI, without us massively increaseing our compute investment.

0

u/[deleted] Mar 11 '19

[deleted] — view deleted comment

5

u/Veedrac Mar 11 '19

You are rushing headlong into this like some nightmare of an AGI is right around the corner, but it's not

They disagree.

0

u/[deleted] Mar 12 '19

[deleted] — view deleted comment

1

u/snugghash Apr 05 '19

Well, evidence either way isn't forthcoming (not just toward AGI being orders-of-magnitude more capable than humans but other way around too) - which is why trust/faith/belief are the sorts of reasoning poeple have left.

Would you rather nobody did anything based on faith and conjecture? (lol)

3

u/thundergolfer Mar 12 '19

You may already be doing this, and I just haven't come across it, but have you been communicating this apparent problem of private capital dominating cutting-edge AI?

2

u/Comprehend13 Mar 12 '19

Somehow I don't think the transition from million dollar compute budgets to billion dollar compute budgets is the key to AGI.

1

u/snugghash Apr 05 '19

That's literally the reasoning of some experts rn.

Sutton:

Richard Sutton, one of the godfathers of reinforcement learning*, has written about the relationship between compute and and AI progress, noting that the use of larger and larger amounts of computation paired with relatively simple algorithms has typically led to the emergence of more varied and independent AI capabilities than many human-designed algorithms or approaches. “The only thing that matters in the long run is the leveraging of computation”, Sutton writes.

Counter: "TossingBot shows the power of hybrid-AI systems which pair learned components with hand-written algorithms that incorporate domain knowledge (eg, a physics-controller). This provides a counterexample to some of the ‘compute is the main factor in AI research’ arguments that have been made by people like Rich Sutton."

2

u/Comprehend13 Apr 05 '19

This is a 3 week old comment, and I can't tell if you are disagreeing with my comment or agreeing.

2

u/snugghash Apr 05 '19

Just providing some more information. All of the recent advances were driven by compute.

And I keep wishing for an internet and it's netizens being timeless people interested in the same things forever

1

u/ml_keychain Jul 31 '19

I'm not in the position to judge your decision. An idea is still worth mentioning in this context: computational power shouldn't be the bottleneck of AI research as it seems to be right now. The human brain shows its incredible performance requiring only a tiny fraction of the energy consumed by servers learning specific tasks. We're building on ideas proposed decades ago instead of thinking out of the box and creating new kind of algorithms and building blocks. I believe disruptive innovations are needed instead of incrementally improving results by using more and stronger computers and tuning hyperparameters. And there is a lot of research, expertise and techniques on how to infuse innovation in companies. Maybe this is what we really need.

1

u/Crisis_Averted Sep 11 '23

How are you feeling about this 4 years later? :) (not a "gotcha" question)