final answer can be considered as a chunk and we can highlight it seems
Somesh Fengade
Someshfengde
AI & ML interests
None yet
Recent Activity
commented on
an
article
4 days ago
How We Built a Semantic Highlight Model To Save Token Cost for RAG
upvoted
an
article
4 days ago
How We Built a Semantic Highlight Model To Save Token Cost for RAG
commented on
an
article
4 days ago
How We Built a Semantic Highlight Model To Save Token Cost for RAG
Organizations
commented on
How We Built a Semantic Highlight Model To Save Token Cost for RAG
4 days ago
upvoted
an
article
4 days ago
Article
How We Built a Semantic Highlight Model To Save Token Cost for RAG
•
45
commented on
How We Built a Semantic Highlight Model To Save Token Cost for RAG
4 days ago
Can this highlight approach be used on final answer generated by LLM?
Most of the times I find LLM generated final answer too verbose. Highlighting within answer will give user ability to see areas which actually matter.
Can you please share the training script you have used to create this
#3 opened 4 months ago
by
Someshfengde
Add ' ' tag
#37 opened 4 months ago
by
Someshfengde
upvoted
an
article
4 months ago
Article
Benchmarking Text Generation Inference
•
34
Add ' ' tag
#35 opened 5 months ago
by
Someshfengde
Add 'tensorflow' tag
#258 opened 6 months ago
by
Someshfengde
Add 'text-to-image' tag
#255 opened 6 months ago
by
Someshfengde
Add 'mcp' tag
#251 opened 6 months ago
by
Someshfengde
Add ' ' tag
#68 opened 6 months ago
by
Someshfengde
Add ' ' tag
#227 opened 6 months ago
by
Someshfengde
Add 'llm' tag
#222 opened 6 months ago
by
Someshfengde
Add 'transformers' tag
#220 opened 6 months ago
by
Someshfengde
Add ' ' tag
#223 opened 7 months ago
by
Someshfengde
Add 'nlp' tag
#146 opened 7 months ago
by
Someshfengde
Add 'pytorch' tag
#3 opened 7 months ago
by
Someshfengde
Add 'and llm related tags' tag
#4 opened 7 months ago
by
Someshfengde
Add 'pytorch' tag
#2 opened 7 months ago
by
Someshfengde
Add 'text generation and llms tags' tag
#1 opened 7 months ago
by
Someshfengde