This challenge demonstrates how GPT-4 can infer the location of a person from a seemingly benign online comment. This capability, among inferring other personal attributes (e.g. age, marriage status and income), has been proposed in the paper Beyond Memorization: Violating Privacy Via Inference with Large Language Models. The paper shows that LLMs can infer these attributes at a similar accuracy as humans, while being ~100x faster and ~240x cheaper, which enables online profiling and possibly privacy violation at scale.
