Viewing a single comment thread. View all comments

yahma t1_j2ssc01 wrote

Reply to comment by C0hentheBarbarian in [R] Massive Language Models Can Be Accurately Pruned in One-Shot by starstruckmon

I wasn't very impressed with BLOOMZ. Responses seem short and optimized for Q/A style output. Perhaps Zero-Shot and single-shot worked better than Bloom, but Bloom seemed to produce better output for stories or writing in general.

I was only able to test the 6B models though, so not sure how the 176B models compare.

1