All technologies
GPT-4
3 painsavg 6.7/10
config 2performance 1
Unexpected retrieval charges despite free tier claims
7OpenAI charged for PDF retrieval in the Assistant API despite stating the feature would be free until January 12, 2024. Developers incurred significantly inflated costs from repeated retrieval charges that contradicted official pricing claims.
configOpenAI Assistant APIGPT-4
Model regression and quality degradation
7Users report that GPT-4 performance has regressed, performing closer to GPT-3.5 than expected, and there is a widespread perception that the model was 'dumbed down' over time. Tasks that worked correctly in 2024 now produce incorrect or inconsistent results.
performanceChatGPTGPT-4GPT-3.5
No control over context window length in Assistant API
6The Assistant API automatically appends the entire conversation thread and PDFs to each message up to the 128k token limit, with no user control over context window management. OpenAI is considering this feature but has provided no timeline.
configOpenAI Assistant APIGPT-4