Best Practice: Hybrid Model Strategy
For optimal performance and cost efficiency:
| • | Use lightweight models as the default for most queries. |
| • | Escalate to high-accuracy models only when needed. |
| • | Use retry or fallback mechanisms for ambiguous or failed queries. |
The following is a summary of the best practice guidelines.
|
Use Case Complexity |
Example |
Recommended Model |
|||||||||
|
Simple |
Usage report, basic filters. |
Lightweight models:
|
|||||||||
|
Medium |
Aggregations, multi-condition queries. |
Hybrid (lightweight > high accuracy)
|
|||||||||
|
Complex |
Predictive insights, ambiguous queries |
High-accuracy models.
|