Comment by thomastill 15 hours ago Congrats! Happy to see someone seriously pursuing this direction. 2 comments thomastill Reply msdz 15 hours ago Same. Models that are fast (and thus by extension, in some direction, efficient) but not local/self-hosted IMO fill a niche for quick and cheap (and acceptable quality, of course) inference in business contexts.
msdz 15 hours ago Same. Models that are fast (and thus by extension, in some direction, efficient) but not local/self-hosted IMO fill a niche for quick and cheap (and acceptable quality, of course) inference in business contexts.
Same. Models that are fast (and thus by extension, in some direction, efficient) but not local/self-hosted IMO fill a niche for quick and cheap (and acceptable quality, of course) inference in business contexts.