Mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Markus Jelsma <markus.jel...@openindex.io>
Subject RE: Help on adding custom headers
Date Wed, 04 Jan 2017 20:46:05 GMT
Hello - there is no way to do this with just configuration. You can, however, modify the protocol-*
plugin you're using. That is the spot to add a custom header for a given condition.

Markus

 
 
-----Original message-----
> From:AshokRaj.Lourdusamy@cognizant.com <AshokRaj.Lourdusamy@cognizant.com>
> Sent: Sunday 1st January 2017 16:47
> To: user@nutch.apache.org
> Subject: Help on adding custom headers
> 
> Hi,
> 
> 
> Is there a way to add headers, whenever the url to be fetched matches a condition.
> 
> Ex: http://www.abc123.com,<http://www.abc123.com> if url contains (abc) then something
like, addheader("username", "nutch")
> 
> ?I think we can add headers for all requests in config. But is this condition check and
adding custom header while crawling urls possible?
> 
> 
> Thanks in advance,
> 
> -Ashok.
> 
> This e-mail and any files transmitted with it are for the sole use of the intended recipient(s)
and may contain confidential and privileged information. If you are not the intended recipient(s),
please reply to the sender and destroy all copies of the original message. Any unauthorized
review, use, disclosure, dissemination, forwarding, printing or copying of this email, and/or
any action taken in reliance on the contents of this e-mail is strictly prohibited and may
be unlawful. Where permitted by applicable law, this e-mail and other e-mail communications
sent to and from Cognizant e-mail addresses may be monitored.
> 

Mime
View raw message