The MyCity chatbot, launched as a pilot program, aims to assist business owners with information from NYC Business webpages.
However, a report revealed the chatbot's inaccuracies in providing legal advice, such as misinformation on Section 8 vouchers and worker regulations.
The chatbot's token-based predictive models can lead to incorrect responses due to gaps in training data.
While warnings acknowledge the potential for harmful content, the chatbot is marketed as a tool to navigate government for business owners.
The report underscores the risks of deploying chatbots without ensuring accuracy, with examples from Air Canada and tax preparation software.
Source: https://arstechnica.com/ai/2024/03/nycs-government-chatbot-is-lying-about-city-laws-and-regulations/
[link] [comments]