Comment by jes5199

8 months ago

I think I have a use for this but I’m realizing that I don’t know how to build a mental model of what is going to parallelize in this system. Surely some algorithms are better and getting chopped up than others - how can I tell what is going on?

1 comment

jes5199

Reply
mjaniczek  8 months ago

I think this is an unsolved tooling question right now.

You could get some sense of the parallelism by using `/usr/bin/time` and dividing the wall time with the user time.

You could look at the Task Manager / Activity Monitor / htop and see if it's using 800% CPU or whatever.

You could use psrecord (https://pypi.org/project/psrecord/) to get a relatively finegrained CPU+mem usage graph across the duration of the program.

But it would probably still be best to record some sort of stats in the Bend/HVM itself, enabled via a CLI flag. Reductions per ms, sampled across the program duration, or something like that.

I'd be interested in anybody's ideas of what a good metric would be here!

EDIT: CLI flag, not CPU flag