On my previous port about netroute2 I said that it was really easy to grab some stats with mrtg about line activity. This has a small drawback, you must have your collector\/server that will run mrtg always open so that it can constantly get the snmp statistics from the modem\/router. So my quest was to figure out a way to keep the statistics on the modem and be able to get them when I want and create the graphs that I like. This is not something mrtg can do, this is an rrdtool job \ud83d\ude42<\/p>\n
Most things said here are based on my previous post about netroute2: Intracom netroute2 hacks<\/a>. You will definitely need to have read it before continuing…<\/p>\n Tweaking the Netroute2: What this script does is parse the output of ifconfig ppp0, find the number of bytes for incoming and outgoing and store them to \/tmp\/var\/for_rrd.log. Remember that netroute2 has \/tmp writable, so we can use\/abuse it \ud83d\ude42 \nTIMESTAMP:OUTGOING:INCOMING<\/p>\n 1160651881:7938452:1310405\n<\/p><\/blockquote>\n So now we can have the stats stored someplace. It’s time to tell netroute2’s cron to do it every X minutes. Now, every 1 minute our log is going to be filled with our traffic. You did remember to run \/etc\/init.d\/checkpoint … didn’t you ? If you don’t know why you should do it…DON’T continue reading on!!! Go back and read this: Intracom netroute2 hacks<\/a><\/p>\n RRDTool time now… BIG FAT WARNING!! <\/strong>You HAVE<\/strong> to change the timestamp –start 1159455804 with the current timestamp if you want to get accurate stats. 1159455804 was when I started getting my stats. You MUST change this with your current one. The command “date +%s” is your friend in this…<\/p>\n Now execute sth like this: “\/bin\/sh create_netroute2_rate.txt”. You should have a beautiful netroute_rate.rrd file inside your current dir. Time to fill up this database with information from the file “for_rrd.log”. (timelapse)<\/p>\n I am supposing you already did it…To check if it’s working issue something like this: Now a command like the following will grab “for_rrd.log” from netroute2 and put it in \/var\/rrds\/ (that’s the dir I am using to store my rrd databases, logs, scripts, etc) Now..parsing time! This is my netroute-rrd.sh: If you execute this script it will compare this script with the older one you had downloaded, diff them and parse the output with rrdtool. I do that to ensure that rrdtool only parses what was not parsed before. It’s really stupid to parse the log file everytime from the beggining…<\/p>\n Now you have your database filled up with values…so what ? how can you see the results ? With a script that takes advantage of rrdgraph \ud83d\ude42 This script is quite big, more than 150lines so I will not copy\/paste it here but I will provide you with a tarball of it and all the previously mentioned scripts ment to be stored on your box. Combine all these together with a cron job from your pc like the following: and you will have a \/var\/rrds\/index.html with 5 graphs: Hourly, Daily, Weekly, Monthly and Yearly.<\/p>\n Now you can monitor your Internet traffic even when your stats collector is offline.
\nThe first thing was to create a script to give me information about incoming and outgoing traffic on ppp0 interface. I also to export these stats on a file “parsable” by rrdtool. The following script does exactly that:<\/p>\n
\n#!\/bin\/sh
\nifconfig=\"\/sbin\/ifconfig\"
\ngrep=\"\/bin\/grep\"
\ndate=\"\/bin\/date\"
\ncut=\"\/usr\/bin\/cut\"
\ntail=\"\/usr\/bin\/tail\"
\ndelim=\":\"
\nOUTPUT=\"\/tmp\/var\/for_rrd.log\"
\nRX=`$ifconfig ppp0 | $grep -A 6 ppp0 | $tail -n 1 | $cut -d\":\" -f2 | $cut -d\" \" -f1`
\nTX=`$ifconfig ppp0 | $grep -A 6 ppp0 | $tail -n 1 | $cut -d\":\" -f3 | $cut -d\" \" -f1`
\necho `$date +%s`\"$delim$RX$delim$TX\" >> $OUTPUT
\n<\/code><\/p>\n
\nThe output of the script is something like this:<\/p>\n
\n
\n# cat \/etc\/cron.d\/cron_rrdscript
\n*\/1 * * * * root \/etc\/rrdscript.sh > \/dev\/null 2>&1
\n<\/code><\/p>\n
\nI suppose you have already installed rrdtool on your favorite distro somehow (emerge,apt-get,rpm,blahblahblah). First thing we need to do is create an rrd database to keep our stats. Save the following in create_netroute2_rate.txt
\n
\nrrdtool create netroute_rate.rrd --start 1159455804 \\
\nDS:IN:COUNTER:600:0:12500000 \\
\nDS:OUT:COUNTER:600:0:12500000 \\
\n--step 60 \\
\nRRA:AVERAGE:0.5:1:2000 \\
\nRRA:AVERAGE:0.5:6:2000 \\
\nRRA:AVERAGE:0.5:24:2000 \\
\nRRA:AVERAGE:0.5:288:2000 \\
\nRRA:MAX:0.5:1:2000 \\
\nRRA:MAX:0.5:6:2000 \\
\nRRA:MAX:0.5:24:2000 \\
\nRRA:MAX:0.5:288:2000
\n<\/code><\/p>\n
\nIf you don’t have yet public key authentication with your netroute2, now is the crucial time to do it. Paragraph F) of my previous post (Intracom netroute2 hacks<\/a>) is exactly that.<\/p>\n
\nssh -l root -p 22 PUT.IP.OF.NETROUTE2.HERE uname -a<\/code>
\nHopefully you’ll get prompted with something like: “Linux netroute- 2.4.30-netta2 #2 Tue Mar 21 10:51:17 EET 2006 ppc unknown”. If not check again what went wrong…<\/p>\n
\nscp root@PUT.IP.OF.NETROUTE2.HERE:\/tmp\/var\/for_rrd.log \/var\/rrds\/for_rrd.log<\/code><\/p>\n
\n
\n#!\/bin\/sh
\ncd \/var\/rrds\/
\nNEWFILE=\"for_rrd.log\"
\nOLDFILE=\"for_rrd.log.old\"
\nif [ ! -f $NEWFILE ]; then
\n echo \"No new file found\"
\n exit 1
\nfi
\ndiff $OLDFILE $NEWFILE | grep -v \",\" | sed 's\/^>[ \\t]\\+\/\/' > to_parse
\ncat to_parse |while read line;
\ndo
\n echo \"${line}\";
\n rrdtool update netroute_rate.rrd $line
\n echo \"$?\"
\ndone
\nrm -f to_parse
\nmv for_rrd.log for_rrd.log.old
\n<\/code><\/p>\n
\nNetroute2 RRDTool Scripts<\/a><\/p>\n
\n*\/5 * * * * scp root@PUT.IP.OF.NETROUTE2.HERE:\/tmp\/var\/for_rrd.log \/var\/rrds\/for_rrd.log ; \/etc\/scripts\/netroute-rrd.sh; \/etc\/scripts\/netroute-rrd-graph.sh<\/p>\n
\nThere is a chance that you will get some spikes when netroute2 reboots. To eliminate them read this: HOWTO remove spikes from RRD graphs<\/a><\/p>\n