multithreading - Multithreaded Pipeline for Java(7) -
i'm building summarizer , need pipeline implementation. i've used own implementation, work grows see won't cut.
is there mature framework in java provides me foundation (basically synchronization logic)?
i need declare stage, , each stage has workers, workers process items , return results stage, sends next stages (might fan out).
the whole point of implementation give me foundation doesn't work (race condition brings deadlock)
i've tried getting apache library (which dead basically) doesn't have feature create stage workers.
just connect stages blocking queues, , work reliably. use bounded arrayblockingqueue avoid saturation of queues if producers work faster consumers.
most pipeline/dataflow/actor frameworks deal tasks small assigning single thread stage overhead stages share thread pool, , have limited number of working threads. framework (probably) exploits several threads per stage fbp, not sure.
Comments
Post a Comment