MMH3 hashes, more tags and better performance

Lots of small changes this week. I got some bugs fixed and improved the performance of the GUI. Most notably in reports and search. You’ll notice when you try a full text search :-)

After JARM hashes, de ShadowTrackr now also tracks the MMH3 hashes for favicons. This is useful to check for similarties with other websites and against phishy urls, but also to pivot to other tools like Shodan. While ShadowTrackr looks in-depth at your infrastructure, Shodan looks more shallow and broad (at the entire internet). You can easily use the JARM hash and MMH3 hash to hunt for similar infrastructure.

Lastly, you can now also tag hosts and subnets. In itself this doesn’t do much yet, but that will change in the coming weeks. There are interesting changes coming. Think of custom alerts based on specific events and tags, and reports based on specific tags. It will take a while to get this fully functional and you’ll see the new features appear in small steps.

UCEPROTECT blacklists removed due to bad behavior

ShadowTrackr uses a lot of OSINT blacklists. This is not something you want to do in your internal SIEM without proper tuning. Any reasonably large organization will have users occasionally hitting blacklisted websites, resulting in quite a few false positives.

The purpose of the OSINT blacklists in ShadowTrackr is different: it’s to check if your public websites or mailservers appear on them. That is something you should always want to know.

Last two weeks, a lot of assets of several different clients turned up on UCEPROTECT blacklists. Often, if the ip or url is really showing bad behavior, you’ll see it listed on multiple blacklists from mutliple organizations. The funny thing about the ip’s showing up on UCEPROTECT was that almost all of them did not show up at other blacklists. That is odd.

When I looked in to the details, UCEPROTECT showed that entire ip ranges and ASNs we’re blocked. These ASNs are all owned by decent providers, and it seemed a bit like throwing out the baby with the bathwater.

I contacted one of the ISPs, and they told me that they were on it and trying to work with UCEPROTECT. Problem was that UCEPROTECT charges a hefty fee to get your ASN de-listed. That is, in the words of the ISP, predatory behavior that they will not put up with. And they are right. So, as of now ShadowTrackr has dropped checking assets againts UCEPROTECT blacklists.

We still use more than 100 other blacklists, and you’re assets will very likely show up on those if they misbehave. So, you should notice any real difference.

New: JARM hashes, and some phishy stuff

There are some major updates to the phishy url detection under way. You’ll have to be patient for the full details because it’s not all ready for production yet. Some stuff has already made it through as you can see on the phishy url report page. ShadowTrackr now has better tracking of whois, certificate and ISP data for your phishy urls.

I also plan to use JARM hashes for better profiling of your existing servers against possible phishy servers. JARM hashes are already found on the phishy url page and on all your existing webpages. You can click on the hashes to pivot and find related infrastructure.