<span class="vcard">/u/Remarkable_Divide755</span>
/u/Remarkable_Divide755

Building independent LLM drift detection – sharing the methodology, looking for feedback on the approach

Disclosed upfront: I run [Tickerr dot ai], an independent external monitor for AI APIs. Today it tracks latency, TTFT, uptime, and error rates across major models. I’m trying to validate a more specific idea before building too much. Basic transport he…

Would you pay for an independent alert service that tells you when an LLM’s behaviour has drifted – before your users notice?

Following up on a thread I posted yesterday about how developers detect LLM API degradation. The responses were useful enough that I want to validate a specific idea. It is a 3 layer independent alert service: Layer 1: Transport health alerts: Independ…

When an LLM API silently fails or degrades, how do you find out – and how long does it take?

Asking to developers and power users, as a genuine research question. If you are building on top of multiple LLM APIs or even a single one amongst OpenAI, Claude, Gemini, etc. what do you do when the API starts degrading (slow TTFT, elevated error rate…