/sci/ - Science & Math

>>14503718
https://www.lesswrong.com/posts/SbAgRYo8tkHwhd9Qx/deepmind-the-podcast-excerpts-on-agi
I suspect as we get closer, the incentive will be even greater to not stop. If you're worried about misaligned AGI in the near future, that means the research field is close to reaching it. That point in time will be where those with higher doom risk tolerances are more tempted to continue research anyway. If you already know what you'll believe in the future, just adopt that belief now. I know it's not a great business move to petition the government to temporarily ban the thing you were hoping to make a profit on, but maybe those with a fixation on the dollar can be incentivized. However, if the government is petitioned by a business which seeks to temporarily ban the thing they were hoping to make a profit on, they might take it seriously because of the incentives that business is ignoring in favor of raising a concern.