AXS Logs

By Jian Shuo Wang on 2003-11-19 09:50 · Backstage

Backing up and Analysizing AXS Logs

According to AX.cgi documentation:

The AXS proprietary log is pipe-delimited and newline separated. Each record contains null leading and trailing fields. The fields are:

0 NULL

1 resolved-ip-address

2 ip-address

3 from-url

4 to-url

5 browser-string

6 time-seconds 0..59

7 time-minutes 0..59

8 time-hour 0..23

9 day-of-month 1..31

10 month-of-year 0..11

11 year-1900 (i.e., 100=>2000, 103=>2003)

12 day-of-week 0..6, sunday=0, saturday=6

13 day-of-year 0..364 0==jan1, 364/65=dec31

14 export||’’ bit field; contains literal word “export” if and only if this was a redirect

15 NULL/newline

So I’d like to seperate the lines into different files grouped by month. For example, all the hit in Augest 2003 should be stored in 200308.txt file, so make it possible to scale up after the logs become too large.