safely merging w machines • previously 0days via RL @Pebble_bed • ctf player @SquidProxyLover • RL for math @caltech • she/they • DMs openquguanni.com sfJoined November 2020
i'd love git and a build system for agent beliefs. git to track which claims changed; a build system to flag every decision that depended on them for re-evaluation
wondering how much alignment is just disagreement below the user's correction threshold, and what happens when a consequential decision needs a distinction finer than that threshold, since acceptance is a noisy label for intention. sometimes it just means “not worth correcting”
a model update can break a security assumption without changing a single API. yesterday the model couldn't connect two harmless-looking tools into a dangerous capability. today it can.
realizing a tool can be read-only and still increase an agent's effective privileges. reading the deployment guide can teach it how to use credentials it already had
and if BCI adapts to how i correct it, and i adapt to which mistakes are easiest to correct, we could converge on a language neither of us would have chosen alone. calibration as accidental language invention
wait so a BCI completing my thoughts can help form the intention i'm supposed to judge it against, and i can reject the suggestion but can't unhear it. make that loop fast enough and .. we are one and thinking them together. 🔗
used to treat thms like black boxes and pull in the proofs lazily to skip prereqs. now i do it to my whole workflow and the proofs never come. i'm just f_want(x) and "looks good i guess".
Merge Me With The Model Please, give me the middle of 🥪
i’m realizing a lot of vulnerability research is matchmaking. i find two components that disagree about what the same bytes mean and introduce them to each other. unfortunately they have chemistry, fall in love, and eventually agree with each other
1/ We shouldn’t measure a math problem’s value by how many steps it takes to solve. A lot of “hard” contest problems will vanish as search and hardware improve. The problems that matter are the ones whose solutions force a new way of thinking.
Wondering how we can make LLM understand the concept of mathematical beauty. If A = B then the further away A is from B the more beautiful a theorem. But some argue that the perception and experience of beauty is personal and not transferable.
what if ai helps the universe’s bubbles fuse before they pop and accidentally creates a new mind? im excited to meet it, also slightly worried im already in its group chat, and the three dots typing indicator is me
maybe a latent thought corresponds to an equivalence class of meaning-preserving representations, and communication selects from the subset the sender can express and the listener can decode. so 10 bits/s may measure the rate of projecting thought into behavior, and not the thought’s intrinsic bitrate.
Wait, the wild part is every Dirichlet L-function, not just \zeta. If correct, that rules out Siegel zeros past 7/8 and gives an x^{7/8+\epsilon} prime-counting error in each fixed progression. How are they controlling the conductor?
Quasi-RH?!?!???! Are you kidding me? If a human did this, it would be an instant Fields Medal, no questions asked.
RH says zeta has no zeros in Re(s)>1/2. The best we had until a second ago was a region that got thinner and thinner the higher up the imaginary axis you go. I
Thoughts on math and AI. Are human mathematicians redundant in a world in which AIs are better than humans at proving theorems? The answer may surprise you.
blog.danromik.com/the-feedback-l…
815 Followers 973 FollowingDisclaimer: The views expressed here are solely my own and do not reflect the views of my employer or any organization I am or was affiliated with
16 Followers 521 Followingcs + neurobio @caltech / prev @stanfordmed, @seattlechildren
life is programmable! ml for proteins + neuro
part-time musical poet and writer
256 Followers 3K FollowingMost of the time, I try to be less confused than yesterday and fail. PhD student in physics @FU_Berlin. Always happy to chat and learn more.
18 Followers 194 FollowingCiudadano del cosmos, empedernido melómano del conticinio, aspirante a ensoñador desadaptativo con toques de curiosidad epistémica.
20K Followers 11K FollowingOn the quest to understand the fundamental mathematics of intelligence and of the universe with curiosity. https://t.co/mMchI2d4pg Upskilling by @StanfordOnline
90K Followers 18 FollowingTrendAI Zero Day Initiative™ (ZDI) is a program designed to reward security researchers for responsibly disclosing vulnerabilities.
106K Followers 954 FollowingOpen model research, founder, director @trillium_labs. Prev. co-led Olmo at Ai2.
Writes @interconnectsai, wrote https://t.co/alRXKINTwE
503 Followers 6 FollowingThe Context Firewall for AI Agents
AIR sits between agents and the outside world, continuously analyzes and filters every input into an agent’s context.
531K Followers 6K FollowingCo-founder & CEO of Discovery Loop. Former Chief Scientist, Google. Helped build many Google products, TPUs, Gemini, TensorFlow, MapReduce, Bigtable, ...
1 Followers 15 FollowingRevolutionizing the tourism industry from Singapore to the world.
Granted by Singapore Tourism Board.
2024 ILTM Top speaker.
2024 TTG Asia Top travel adviser.
22K Followers 646 FollowingFounder @RicursiveAI, Asst. Prof. of CS at Stanford. Prev: DeepMind, Anthropic, Brain. Co-Creator of MoEs, AlphaChip, Test Time Scaling.
43K Followers 1K FollowingCEO and co-founder of @coreauto
former VP of RL @ OpenAI : reasoning models, o3, o1, GPT4, ChatGPT, Codex, RL for robots
cautious AI optimist
3K Followers 241 Following@nusingapore '24 | databases → RL infra → financial world models | 12++ solo hack wins (CalHacks,HTN etc.) | angel investor | i like making fast things
11K Followers 271 Followingsecurity enthusiast that loves hunting for bugs in the wild. co-founder and player of @justCatTheFish.
infosec at @google. opinions are mine.