Mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matt Joseph <matt.deepd...@gmail.com>
Subject How can I send nutch docs to rabbit mq?
Date Fri, 23 Dec 2016 00:20:33 GMT
Currently I use elastic-indexer plugin to index on elasticsearch, but
requirements have changed and I now need to send nutch results to a rabbit
exchange.

I have seen publish-rabbitmq but this seems to be for status messages
instead of actual crawled documents. I also tried adding an exchange
publish method to get called each time the elastic-indexer write() method
is called and this worked when i ran a job manually but not when run on
hadoop.

I just want to redirect docs to a rabbit queue instead of an elastic index.
Is there a plugin/simple method for this?

Thanks

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message