Comment by serbuvlad
1 day ago
ripgrep may be.
I did a toy project once implementing a limited version of grep on an FPGA and was able to get some speedup over GNU grep at the time, though marginal.
In any case, LLMs aren't IO bound :))
1 day ago
ripgrep may be.
I did a toy project once implementing a limited version of grep on an FPGA and was able to get some speedup over GNU grep at the time, though marginal.
In any case, LLMs aren't IO bound :))
I am now imagining a future where developers buy fancy "grep cards" for their machines. I don't hate it.
These are properly called "GPUs", as in "Grep Processing Units"!
It would be cool if they could be daisy-chained, so you can have a hardware implementation of |
The return of the Transputer.
Put a Transputer in a Lego brick. Not "like a Lego brick", an actual Lego brick. Turn the notches into connectors for the serial link.
Plug'n'play.
The next logical step would be to have a separate card for each Unix utility.
11 replies →
I wonder how close you can get with Nvidia's GPUDirect. Hook the fast NVME directly up to the GPU (well, it gets direct DMA to GPU at any rate), then implement parallel grep in CUDA... profit?
I look forward to GPGrepPU -- someone'll find a way to abuse them for scientific workloads or something.
GrePU
Universal Basic ASICs
If your BASIC is compiled that's just a CPU!
At some point Intel was experimenting a Xeon with built-in FPGA, maybe they were just a bit too early to the game :)
Almost 30 years ago there was a project about making a computer which used FPGAs for all "software". It was called RAW.
Baring it all to software: Raw machines | IEEE Journals & Magazine | IEEE Xplore https://share.google/nI9GyFJu4HvbYFrBf
(If you Google the name you will find free PDFs as well, the IEEE page is more useful as a summary and such.)
I've evaluated some of these and in almost all cases they failed to outperform Intel's ridiculously optimized CPU regex library, hyperscan.
Right, but I read the comment's point as: being i/o bound is the eventual limit of the asymptote and it's the same one grep has.