Crawler is banned by USCIS.gov

Jin Shen

7 months ago

Unfortunately, the crawler is banned by USCIS.gov two days ago.

I'm actively looking for a mitigation.

Please stay tuned.

Shawn C

7 months ago

USCIS regulated API may be a workaround, hope it helps.

source: https://www.reddit.com/r/USCIS/comments/1es0t0x/update_from_track_my_visa_now/

Jin Shen

7 months ago

Thanks, Shawn, That's really helpful. I paste the announcement from TrackMyVisaNow here:

Accordingly, I'm starting the process of App registration on USCIS and hopefully I can schedule a review session with them as soon as possible.

Curious Cat

7 months ago

I think it'll still need that approval you mentioned but looks like they are expecting changes in terms of throttling the calls per day, etc - if we keep it to < 150K per day, that will solve the problem (so late updates/updates over days) ~

Case Status API – Production Features & Capabilities

The following are available in Production:

Live receipt numbers are supported.
Staging Receipt Numbers are not supported.
Quota is limited to 150,000 daily and resets everyday at - 04:00 UTC (Midnight EST).
API concurrency limit is set to 10 transaction per second (tps)

Jin Shen

7 months ago

Thanks, Curious Cat for the information.

The capacity limit will highly impact the crawler though. As currently, there were 10M+ cases are crawled every day.

Christina Persaud

7 months ago

Why am being blocked

Bharath Sivakumar

7 months ago

hi Any update on crawler?

Jin Shen

7 months ago

Crawler is back and running.

Check status here https://hilites.today/crawler-status

Community

Crawler is banned by USCIS.gov