Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a crawling pass that retries components which have faced errors before #32

Open
bhermann opened this issue Nov 9, 2018 · 0 comments
Milestone

Comments

@bhermann
Copy link
Member

bhermann commented Nov 9, 2018

Is your feature request related to a problem? Please describe.
After #31 is implemented we are very aware of components that faced errors before.
However, there is no process that picks up the components which failed.

Describe the solution you'd like
Add a crawler source that feeds from the list of errors in the elasticsearch index. In order to avoid infinite retries a circuit breaker should be established here.

Describe alternatives you've considered
None

Additional context
None

@hariharansrc hariharansrc self-assigned this Dec 3, 2018
@bhermann bhermann added this to the 2019.1 milestone Aug 29, 2019
@bhermann bhermann modified the milestones: 0.9.5, 0.9.6 Jun 14, 2020
@johannesduesing johannesduesing self-assigned this Jul 13, 2020
@johannesduesing johannesduesing removed their assignment Sep 30, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants