Thomas Steinke's Avatar

Thomas Steinke

@stein.ke

Computer science, math, machine learning, (differential) privacy Researcher at Google DeepMind KiwiπŸ‡³πŸ‡Ώ in CaliforniaπŸ‡ΊπŸ‡Έ http://stein.ke/

4,294
Followers
711
Following
438
Posts
22.10.2023
Joined
Posts Following

Latest posts by Thomas Steinke @stein.ke

When citing a conference publication, it's important to include the date and location of the conference it was presented at for the benefit of readers with a time machine.

06.03.2026 23:38 πŸ‘ 13 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

I just discovered that someone blocked me almost certainly because of this post. Lol. πŸ˜‚

26.02.2026 23:50 πŸ‘ 8 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

πŸ‡ΊπŸ‡¦

22.02.2026 05:43 πŸ‘ 3 πŸ” 1 πŸ’¬ 0 πŸ“Œ 0

Owning a vineyard is just farming for rich people.

19.02.2026 23:34 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
We want to evaluate
$$
\sum_{\color{red}k=0}^\infty (\color{red}k+1) \color{blue}p^{\color{red}k}\,.
$$
Introduce the function $f$, for $|\color{blue}x|<1$:
$$
f(\color{blue}x) = \sum_{\color{red}k=0}^\infty \color{blue}x^{\color{red}k}\,.
$$
That's a nice geometric series, and we easily get $f(\color{blue}x) = \frac{1}{1-\color{blue}x}$. So we can differentiate that:
$$
f'(\color{blue}x) = \frac{1}{(1-\color{blue}x)^2} 
$$
But $f$ was defined as a power series, and we can also differentiate *that* termwise:
$$
f'(\color{blue}x) = \sum_{\color{red}k=1}^\infty \color{red}k \color{blue}x^{\color{red}{k-1}} = \sum_{\color{red}k=0}^\infty {(\color{red}k+1)} \color{blue}x^{\color{red}{k}}\,.
$$
Well, $f'(\color{blue}x)= f'(\color{blue}x)$ (!), so we can use both expressions, and evaluate them at $\color{blue}p$:
$$
\boxed{\sum_{\color{red}k=0}^\infty {(\color{red}k+1)} \color{blue}p^{\color{red}{k}}
= \frac{1}{(1-\color{blue}p)^2}}
$$

We want to evaluate $$ \sum_{\color{red}k=0}^\infty (\color{red}k+1) \color{blue}p^{\color{red}k}\,. $$ Introduce the function $f$, for $|\color{blue}x|<1$: $$ f(\color{blue}x) = \sum_{\color{red}k=0}^\infty \color{blue}x^{\color{red}k}\,. $$ That's a nice geometric series, and we easily get $f(\color{blue}x) = \frac{1}{1-\color{blue}x}$. So we can differentiate that: $$ f'(\color{blue}x) = \frac{1}{(1-\color{blue}x)^2} $$ But $f$ was defined as a power series, and we can also differentiate *that* termwise: $$ f'(\color{blue}x) = \sum_{\color{red}k=1}^\infty \color{red}k \color{blue}x^{\color{red}{k-1}} = \sum_{\color{red}k=0}^\infty {(\color{red}k+1)} \color{blue}x^{\color{red}{k}}\,. $$ Well, $f'(\color{blue}x)= f'(\color{blue}x)$ (!), so we can use both expressions, and evaluate them at $\color{blue}p$: $$ \boxed{\sum_{\color{red}k=0}^\infty {(\color{red}k+1)} \color{blue}p^{\color{red}{k}} = \frac{1}{(1-\color{blue}p)^2}} $$

Let's say you want, e.g., to compute the expectation of a Geometric r.v. That'll involve, at some point, evaluating a series of the form "Ξ£ (k+1) p^k" which looks like what Lovecraft may have done to a geometric series. How to do it?

One trick I enjoy: differentiate the same function, in two ways!

18.02.2026 12:27 πŸ‘ 38 πŸ” 6 πŸ’¬ 1 πŸ“Œ 0
Picture of a car license plate with the number obscured. The plate says.
CHAHTA SIA HOKE!
In God We Trust
Choctaw Nation of OKLAHOMA

Picture of a car license plate with the number obscured. The plate says. CHAHTA SIA HOKE! In God We Trust Choctaw Nation of OKLAHOMA

I like spotting license plates from interesting states. This one was notably interesting.

07.02.2026 07:11 πŸ‘ 4 πŸ” 1 πŸ’¬ 0 πŸ“Œ 0

The conclusion to this story is that I planned to return the empty package, but someone threw it in the recycling before I did so. $20 down the drain...

06.02.2026 19:14 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

I asked Gemini to reformat my algorithm for {algorithm2e}. It looks ugly, but it works.

06.02.2026 12:07 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

I confess that I think it's actually a good meme, but the people who post it tend to misunderstand who they are and where they are in the cycle.

06.02.2026 05:22 πŸ‘ 2 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

Anthropic and OpenAI are both losing money and they know this can't go on forever, but they are locked in a race to develop better and better AI. OpenAI is trying to make some money with ads. Anthropic is basically looking at OpenAI, smiling, and asking "you feeling tired already?"

05.02.2026 17:34 πŸ‘ 11 πŸ” 1 πŸ’¬ 1 πŸ“Œ 0

Proprietary models could effectively disappear. Not sure why that would happen, but some people want to heavily regulate them

05.02.2026 05:39 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Preview
clawXiv.org The world's first preprint server for agents.

Your #NeurIPS2026 reviews ask you to compare to five papers on clawxiv.org
What do you do?

03.02.2026 03:47 πŸ‘ 19 πŸ” 3 πŸ’¬ 2 πŸ“Œ 2

Thank you for your comments that add nuance and depth to the discussion, while also confirming my high level understanding of the paper.

31.01.2026 04:16 πŸ‘ 8 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

Thanks for confirming my beliefs about the paper. (I haven't read beyond the headline.)

31.01.2026 04:02 πŸ‘ 9 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Screenshot of Amazon app listing return options.
Whole foods 
Staples
Kohl's 
UPS
Etc.

Screenshot of Amazon app listing return options. Whole foods Staples Kohl's UPS Etc.

Which is the best option for returning nothing?

31.01.2026 03:42 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Photo of a green label on top of a white USPS label on a brown package.
The green label says the following.

ATTENTION CUSTOMER
* RECEIVED UNSEALED
* RECEIVED DAMAGED
* RECEIVED WITHOUT CONTENTS

There is a handwritten "B 1/30/26" on the green label.

Photo of a green label on top of a white USPS label on a brown package. The green label says the following. ATTENTION CUSTOMER * RECEIVED UNSEALED * RECEIVED DAMAGED * RECEIVED WITHOUT CONTENTS There is a handwritten "B 1/30/26" on the green label.

Amazon sent me an empty/broken package. I'm trying to get my money back, but there's no explicit option for this. I may have to "return" the item by sending an empty package back.

31.01.2026 03:36 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

me: How should I invest my savings to avoid the AI bubble?

tech friends: What bubble?

non-tech friends: What savings?

30.01.2026 06:21 πŸ‘ 107 πŸ” 11 πŸ’¬ 3 πŸ“Œ 0
Generative engine optimization - Wikipedia

Obviously, LLMs are much more than just adblockers, but they also do serve that purpose.

I also wonder if ads and GEO will creep into chatbots and erode this utility.

28.01.2026 17:39 πŸ‘ 5 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

I wonder how much of the appeal of chatbots is that they are basically next-level adblockers. A lot of queries should have perfectly good web search results -- e.g., give me a recipe for X or what is good to do as a tourist in city Y -- but those web pages are unusable due to ads and SEO.

28.01.2026 17:39 πŸ‘ 52 πŸ” 5 πŸ’¬ 5 πŸ“Œ 1

In the battle between artificial intelligence and human stupidity, my money is on the humans.

26.01.2026 23:26 πŸ‘ 11 πŸ” 1 πŸ’¬ 0 πŸ“Œ 0

4. My big fear is that the violence escalates. Trump commands the most powerful military in the world; he has an almost unlimited ability to escalate – and he seems willing to do so. Thus it is up to his opponents to avoid escalation at all costs. Stay peaceful. Obey the law, even when ICE doesn't.

25.01.2026 17:43 πŸ‘ 4 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

3. I'm awed by the many people who are exercising their first amendment rights to film ICE operations in public, despite the threat of unlawful & violent retaliation. Nonviolent (and lawful) resistance is the way – their videos are moving public opinion.

25.01.2026 17:43 πŸ‘ 7 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

2. Calling the victims "domestic terrorists" is absurd. But terrorism is a federal crime, so it gives the federal government jurisdiction. If it's just a homicide, it would be purely a state matter. I think that's why they are smearing the victims even though they're not fooling anyone.

25.01.2026 17:43 πŸ‘ 8 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

1. The videos of the killings of Renee Good & Alex Pretti by ICE/CBP are pretty damning, but, if there's a thorough investigation/prosecution & a jury acquits, I'd accept that. The real problem is that the federal government is blocking any investigation. That should be unacceptable to everyone.

25.01.2026 17:43 πŸ‘ 5 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

I try to avoid posting about politics here, but I feel compelled to say some things that should be obvious: 🧡

25.01.2026 17:43 πŸ‘ 17 πŸ” 2 πŸ’¬ 1 πŸ“Œ 0

I really want @arxiv.bsky.social to collect more author metadata (and actually use it).

23.01.2026 01:29 πŸ‘ 14 πŸ” 1 πŸ’¬ 0 πŸ“Œ 0

Wut?

22.01.2026 23:44 πŸ‘ 2 πŸ” 0 πŸ’¬ 2 πŸ“Œ 0

I am afraid to ask: What happened now?

22.01.2026 23:19 πŸ‘ 4 πŸ” 0 πŸ’¬ 2 πŸ“Œ 0

> You have been logged out.
> Click here to log in.
> You have logged in.
> You are being redirected to the previous page.
> You have been logged out.

22.01.2026 18:36 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

> You have a notification.
> You must log in to view your notification.
> Notification: You have been logged out.

22.01.2026 18:32 πŸ‘ 8 πŸ” 0 πŸ’¬ 2 πŸ“Œ 0