Mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sujen Shah <sujen1...@gmail.com>
Subject Re: Crawling to send data to Kafka.
Date Wed, 04 Jan 2017 17:46:09 GMT
Hi Vicky,

I have already written a plugin to send fetcher events to Kafka. You can
have a look here - https://github.com/sujen1412/nutch/tree/kafka

I have to clean it up and push it upstream to Nutch. It would be great to
get your inputs on the plugin.

Thank you!

Regards,
Sujen Shah
Data Scientist
NASA Jet Propulsion Laboratory
http://www.linkedin.com/in/sujenshah

On Wed, Jan 4, 2017 at 9:29 AM, Furkan KAMACI <furkankamaci@gmail.com>
wrote:

> Hi Vicky,
>
> Could you check this issue: https://issues.apache.org/
> jira/browse/NUTCH-2132
>
> Kind Regards,
> Furkan KAMACI
>
> On Wed, Jan 4, 2017 at 7:26 PM, vickyk <vickykak@gmail.com> wrote:
>
> > We got a requirement to have the crawling pushing the data to the Kafka.
> I
> > have looked at the
> > https://wiki.apache.org/nutch/AboutPlugins
> >
> > I am planning to write a custom plugin of type Parser to push messages
> into
> > the Kafka. Will this the appropriate core extension point to extend?
> >
> > PS: I have spend substantial time in searching about it however I did not
> > find any related useful information.
> >
> > Thanks,
> > Vicky
> >
> >
> >
> >
> > --
> > View this message in context: http://lucene.472066.n3.
> > nabble.com/Crawling-to-send-data-to-Kafka-tp4312320.html
> > Sent from the Nutch - User mailing list archive at Nabble.com.
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message