AI & Society

People Ask Chatbots About Benefits. Who Checks the Advice?

LiveAIWire AI News and Insights
LiveAIWire covers the latest AI news, developments and insights in artificial intelligence.

AI benefits advice is no longer only a hypothetical government service. People applying for or receiving support in Britain are already asking commercial chatbots to explain rules, clarify letters and help them work out what to do next. Researchers at the University of York have analysed 271 conversations involving current Universal Credit and Personal Independence Payment recipients, revealing how people try to use ChatGPT, Claude and Gemini to navigate the difficult administrative side of claiming.

The research, accepted for publication in October 2026, makes an important distinction. The study examines how claimants use AI and what burdens they are trying to reduce. It does not establish that the answers given by the chatbots were always correct, that claims were improved as a result or that the people studied represent every benefit claimant in Britain.

Why AI benefits advice appeals to people facing complicated rules

A benefits system can place several demands on somebody at once. They must understand which information is required, assemble documents, explain changes in their circumstances and respond when a department asks another question. Some of those jobs are simple in principle but exhausting in practice. A letter may contain unfamiliar vocabulary or refer to a step that is obvious to the person who wrote it but confusing to the person who received it.

The York researchers describe learning, compliance and psychological burdens. In plain English, those are the work of understanding the system, doing what it asks and coping with the stress created along the way. An AI chatbot can appear attractive because it is available without an appointment, allows someone to ask an apparently basic question and can explain a sentence several times in different words.

That is a real practical benefit even before any question of legal or financial accuracy is considered. A person who feels embarrassed asking a relative for help might be willing to question a chatbot repeatedly. Somebody dealing with a long letter may prefer to work through its sections one at a time. A fluent explanation can reduce the immediate sense of confusion, even if the response must still be checked.

The conversations studied included users who were already receiving Universal Credit or PIP. That matters because managing a claim is not a single application event. Recipients may need to report new circumstances, attend assessments, provide evidence or make sense of decisions after payments have begun. The research therefore looks at practical encounters with an ongoing system rather than merely asking people whether they think chatbots sound helpful.

The danger is an answer that sounds settled when the rules are not

Benefits guidance often depends on individual details: which country of the UK somebody lives in, their age, earnings, household situation, dates and the type of support involved. A chatbot can provide a plausible general explanation while missing the one circumstance that changes the practical outcome. The user may not know which qualification the model has overlooked. That makes fluent certainty particularly risky in a high-stakes setting.

For Universal Credit, the government’s official claim guidance describes the application process and warns that moving from existing benefits can have consequences. The source is not an optional detail. Before acting on an AI answer about making a new claim, a person should check the official position for their circumstances, especially where an existing award or deadline could be affected.

PIP has its own process, including an initial claim and information about how a condition affects everyday life. The government’s PIP guidance also makes clear that claiming arrangements vary by location, including different routes for Scotland and Northern Ireland. A generic chatbot instruction that assumes one nationwide system may therefore be inappropriate. The distinction is part of getting the advice right, not a minor administrative footnote.

None of this means the York research found a particular number of incorrect AI answers. Its published summary does not supply that kind of accuracy audit. The concern follows from the nature of personalised administrative advice and from the limits of what the study claims to establish. It would be misleading to turn an investigation of chatbot use into a statistic about how often they get claims wrong.

Good explanations and reliable decisions are different services

A chatbot can be useful when it helps a person understand the structure of a letter, prepare questions for an adviser or work out which official page they need to read. It is less suitable as the final authority on whether somebody qualifies for a particular award or should abandon a current claim. The more serious the consequence, the stronger the reason to obtain a current official or qualified human answer.

Consider someone who asks, in ordinary language, what a request for further evidence means. The chatbot might help translate formal wording and suggest a checklist of questions. It should not be trusted to invent the correct deadline if the date is missing from the material provided. The person still needs to inspect the actual notice and confirm any required action with the issuing authority.

Privacy matters just as much. Benefit documents can include health information, financial details, identification numbers and personal circumstances. Copying all of that into a consumer chatbot may create risks unrelated to the correctness of the answer. People should avoid sharing unnecessary sensitive details and check the service’s privacy controls before uploading official correspondence.

The issue echoes other services where AI promises to reduce administrative friction. LiveAIWire has reported on the continued importance of being able to reach a human in customer service. That principle becomes especially important when a question concerns rent, income or a disability-related payment and the consequences of a mistake may be difficult to reverse.

What the research tells policymakers about hidden demand

There is a wider lesson in the fact that people are already using third-party chatbots. Governments do not have to deploy an official AI benefit adviser before AI becomes part of the benefits experience. If members of the public bring their own tools to interpret official processes, public agencies must still communicate clearly enough for their information to be checked against reliable sources.

The authors argue that this behaviour has potentially significant and unpredictable implications for social security administration. A claimant might arrive at an appointment better prepared after using a chatbot, or with a confident misunderstanding that takes time to untangle. Both possibilities matter. The study provides evidence of the behaviour itself, not a reliable numerical forecast of its administrative consequences.

In an April 2026 parliamentary answer, the Department for Work and Pensions said generative AI was not then being used directly by the department to assist people in making benefit claims. It also said it was exploring possible digital improvements subject to safeguards. That official position needs to be distinguished from people independently asking commercial chatbots questions about their benefits.

LiveAIWire has previously examined how small mistakes in AI financial explanations can matter. Benefits questions have their own rules, but a similar standard of care applies: a helpful explanation is not enough when an unsupported number or omitted condition could affect a financial decision.

For charities and advice organisations, this may create a new form of work. An adviser could encounter someone with a printed chatbot answer and need to establish which parts are correct, which depend on missing information and which are simply not supported. Clear official documents, accessible explanations and routes to human assistance become more valuable rather than less as automated advice becomes commonplace.

There is an opportunity too. The repeated questions people ask chatbots may expose places where official guidance is too difficult to understand. Those questions could help designers improve public information if collected and evaluated with appropriate privacy safeguards. The right response is not necessarily to copy the chatbot’s style, but to notice which steps require an explanation that ordinary readers can actually use.

LiveAIWire has also examined research into interfaces that adapt to people’s accessibility needs. Making complex services easier to understand is a related design challenge, although adaptive screens and reliable benefit advice are not the same technology or claim.

There is a practical distinction between checking a general rule and interpreting an individual decision. Official websites can explain which forms exist and where an appeal begins. The person receiving a decision may still need an adviser to examine their evidence, the stated reasons and any deadline. An AI-generated interpretation should not be treated as a substitute for that careful review. Nor should somebody rely on an invented contact address or a chatbot’s assurance that missing a required date will not matter.

The York paper’s most important contribution is to show that AI use by claimants is happening already, largely outside the formal machinery of government. For an individual, the sensible division of labour remains straightforward: use a chatbot to help formulate questions and understand unfamiliar language, then confirm consequential advice with official guidance or a qualified adviser. The tool can help somebody prepare, but it should not quietly become the authority deciding their claim.

About the Author

Stuart Kerr is Technology Correspondent at LiveAIWire, covering artificial intelligence, cybersecurity and the social impact of emerging technology. LiveAIWire is an independent, human-led technology publication using AI-assisted research, editorial production and original AI-assisted editorial illustrations under his direction.