ASM Status

Release Notes

Major Crawler Update

The crawler is now better simulating human actions such as mouse movements, page scrolling, and delays before performing searches. This change affects all scrapes that rely on our Crawler. In other words, verifications that use an api integration or a data dump are not affected.

We hope that this will reduce the number of sites that block us as it does not obviously look like a bot. Our volume will continue being high so we are still at risk of getting blocked. An example of a site that is no longer blocking us directly because of this update is:

StateLicense NC_1

• Crawler now mimics how a human would interact with a site
• Those behaviors are now allowing us to circumvent the site's bot detection

Moving FSMB Sites

We have previously released FSMB as a new site instead of replacing the broken site. This was done because they rarely have full coverage, but we now replace the broken sites even though there is not full coverage. Here is the backlog that was updated.

Georgia (GA_1)

Hawaii (HI_1)

Idaho (ID_1)

Mississippi (MS_3)

Montana (MT_1)

Nevada (NV_1)

New Hampshire (NH_2)

New Mexico (NM_1)

Utah (UT_1)

Vermont (VT_1)

Bugfixes

StateLicense OH_1/OH_2/OH_3

• They have just unblocked us.
• We are back to scraping the main site for OH licenses instead of using FSMB

Desktop Verification App

Adding support for a future MD-Staff Verification Desktop Application.