Status updates | Truefoundry Incidents and maintenance reported on status page for Truefoundry https://status.truefoundry.com/ https://d1lppblt9t2x15.cloudfront.net/logos/e8af6b59ef07cff80180e598c505bab8.png Status updates | Truefoundry https://status.truefoundry.com/ en User login page erroring out https://status.truefoundry.com/incident/1070325 Fri, 18 Sep 2026 23:20:00 -0000 https://status.truefoundry.com/incident/1070325#cc1d89cb95d1bd5923d95c2e87632d1390b8054145f9351b77b9d80344bb9660 Incident Due to a bug in 0.173.0 that broke the tenant info fetch API, the login page started failing with a 500 error. Browser caching masked the failure for existing logged-in users; it only surfaced on a cold tenant lookup, i.e., for a new user or a user who had logged out and was trying to log in again. Upon finding the root cause, a fix was released immediately to resolve the issue. User login page erroring out https://status.truefoundry.com/incident/1070325 Fri, 18 Sep 2026 14:30:00 -0000 https://status.truefoundry.com/incident/1070325#e4bb285e4d5c9d51db7c18e1d2e29e37f8be4439f279bc55b03960a22c8d510e Incident Users are unable to login with truefoundry as the Login page is failing 500 error. Control plane APIs degraded https://status.truefoundry.com/incident/1030578 Mon, 24 Aug 2026 10:50:00 -0000 https://status.truefoundry.com/incident/1030578#6495080e8f2c17dd05faebc0e13c863dfcbccf178032de94440a1bf06c0cdeee Incident Control plane APIs are functional Control plane APIs degraded https://status.truefoundry.com/incident/1030578 Mon, 24 Aug 2026 10:41:00 -0000 https://status.truefoundry.com/incident/1030578#bcd49fcc31d5dd77a0fadd4394fc21656befe765223caedb754a1b9783df82ab Incident A change in control plane load balancer affected the availability of control plane apis Logins and signups are failing https://status.truefoundry.com/incident/965785 Thu, 16 Jul 2026 10:01:00 -0000 https://status.truefoundry.com/incident/965785#38d94336b1a2f9729f4e97c6f3e4b319fa25b0f11fa06c8c6a4717cee04c9ed7 Incident The root cause was the dependence of an upstream provider on cloudfront which underwent a global downtime. We are completely up now Logins and signups are failing https://status.truefoundry.com/incident/965785 Thu, 16 Jul 2026 08:17:00 -0000 https://status.truefoundry.com/incident/965785#74f5a78ba253fedd820d3f105931ab7cb2eebac67978e5117cccd15a8fbf84d6 Incident Logins and signups are failing for all users Some of the requests on Truefoundry control plane UI are getting timed out https://status.truefoundry.com/incident/964839 Wed, 15 Jul 2026 14:05:00 -0000 https://status.truefoundry.com/incident/964839#1eefe334986cf923e54d513569f5ed38ed3042c8b429f503c075c4cbc5c191e9 Incident We have identified the issue and mitigated it. TrueFoundry Control Plane UI is healthy now. Some of the requests on Truefoundry control plane UI are getting timed out https://status.truefoundry.com/incident/964839 Wed, 15 Jul 2026 13:51:00 -0000 https://status.truefoundry.com/incident/964839#fe872222dc48d752f89be9cfa5931c2d779583dc8363822f6dbfc95c6111c349 Incident Some of the requests on Truefoundry control plane UI are getting timed out. We have the root cause and are working on fixing it Control Plane APIs failing with intermittent 500 errors https://status.truefoundry.com/incident/914693 Fri, 05 Jun 2026 15:28:00 -0000 https://status.truefoundry.com/incident/914693#9ceb06f1e30f7cbde98a8c175e8e6355f2e51415318653a5220ad1858d44c123 Incident We have identified the root case and resolved it. Few of the MCP server API was affected causing errors in Frontend to crash with 500 error page. We have mitigated the issue and all control plane APIs are up now. This does not affect any AI Gateway functionality. Control Plane APIs failing with intermittent 500 errors https://status.truefoundry.com/incident/914693 Fri, 05 Jun 2026 14:30:00 -0000 https://status.truefoundry.com/incident/914693#fff22edcfe92b6cd92f54a7f640cb666f8b0f891728134e11e4754f8ee2478b1 Incident Control Plane APIs failing intermittently with 500 errors. During rollout, few APIs have started failing with 500 errors intermittently. AI Gateway: chat/completions API with 'prompt_fqn' failures https://status.truefoundry.com/incident/904879 Fri, 22 May 2026 16:42:00 -0000 https://status.truefoundry.com/incident/904879#87f4b9ae938add4c18d224483dab06450ce411d4a41379e3ac328bd9fae2d9d5 Incident We have identified the issue in the authorization of prompts in AI Gateway leading to failures in request containing prompt_fqn in chat/completion API. This was because of a bug in the gateway code that affected prompt hydration in the gateway and resulted in authorization errors. We will be adding more tests to safeguard this code path so that this doesn’t happen again in the future. We have resolved the issue completely. AI Gateway: chat/completions API with 'prompt_fqn' failures https://status.truefoundry.com/incident/904879 Fri, 22 May 2026 06:52:00 -0000 https://status.truefoundry.com/incident/904879#a8e33e57c4a276443e32034fb287d429ba83d7840e725bcf163dda2c6b66a0ae Incident chat/completions API request with prompt_fqn in the request body started failing with error: 'An error occurred while processing prompt configuration: Prompt not found or access denied: <prompt_fqn>'. AI Gateway: Some regions experienced 401 error for inference APIs https://status.truefoundry.com/incident/889286 Wed, 06 May 2026 11:30:00 -0000 https://status.truefoundry.com/incident/889286#d14667f9124120b0cc3b509b20a98d798f20d7ff181919e0b20db28835ab951a Incident We have identified the root cause and resolved it. All the regions of AI Gateway are operational now and we are actively monitoring for any issues. AI Gateway: Some regions experienced 401 error for inference APIs https://status.truefoundry.com/incident/889286 Wed, 06 May 2026 11:20:00 -0000 https://status.truefoundry.com/incident/889286#58ccc470765a38a0b342e355dabb9f913f5cdeb963cb48766d463ed2676a02eb Incident Some users were experiencing 401 error for their LLM Model inference via AI Gateway. Following error was observed in few of the regions. Error code: 401 - {'status': 'failure', 'message': 'Unauthorized: Invalid token: Unable to verify signature', 'error': {'message': 'Unauthorized: Invalid token: Unable to verify signature', 'type': 'Error', 'code': '401'}, 'error_origin_level': 'authentication'} Incident started at 11:20 AM UTC on 6th May 2026 and was successfully resolved at 11:30 AM UTC, 6th May 2026. Duration of incident: 10 min. Platform is not loading and giving intermittent 500 page https://status.truefoundry.com/incident/889303 Tue, 05 May 2026 15:14:00 -0000 https://status.truefoundry.com/incident/889303#b8ad9723a7fa23ab78382a4eabed9006a71929483ceed116a3d95a0d87bf9e76 Incident We have identified the root cause and resolved the issue. All the APIs and Platform UI are operational. We are actively observing for any issues. Platform is not loading and giving intermittent 500 page https://status.truefoundry.com/incident/889303 Tue, 05 May 2026 15:02:00 -0000 https://status.truefoundry.com/incident/889303#b40fbe4fb050dbaa0847086bef9cda721e977a91146ae696aee3415cdd3b4d56 Incident Platform was not loading intermittently and giving a 500 error page. Users are unable to use the Platform using UI. Deployment APIs are giving 500 error intermittently and AI Gateway is completely operational.