Select report columns with | table

Last week custom reports went live. One of the first things you of course want is the ability to select the columns or fields you want in the search results and exports. For that, we now have the keyword table.

Just like in Splunk, you can "pipe" queries in to other commands. For now only the table command is supported. With table you can explicitly select the columns you want in the search results. It works on all queries, including queries with the by keyword. All queries where results are grouped with by will always contain the count per group in the last column (named "count").

Here is an example query to try:

index=websites latest=-7d | table url ip https_status http_status

You can also use | table to select columns in combination with the by keyword in grouped results:

index=hosts by asn | table asn country

In beta: custom reports

After many request, it is finally here! The left hand menu of the GUI shows a new item: custom reports. Reports are query based. All query results you see in the GUI will be in the report too.

You can schedule reports daily, weekly or monthly. Output formats are Excel, csv, json and pdf. Note that the pdf version will switch to rows instead of columns for any output containing more than 5 columns. You can select your columns with the new keyword "table" in the query like this:

index=hosts ports=3306 | table ip  ports asn last_seen

First quirk to be solved: when you create a new report, you have to save it first before you can add email recipients.

Select your own table fields for queries and export

We’ve borrowed yet another keyword from SPL: table.

Table is a search modifier that allows you to select which fields you want to have shown in the GUI or exported in an Excel file. By default you get the fields that we think are most useful. Since “useful” depends a lot on what you are looking for you should be able to determine this yourself. Now you can. Here are a few examples:

If you want all titles on both the http and https version of your websites, try this:

   index=websites | table url https_title http_title

If you want all raw headers for your website, this query will do it:

   index=websites | table url https_headers

For a list of all nameservers specified at your domain registrar, try:

   index=whois | table domain nameservers