Board index » Web Programming » Check for increase in traffic

Web Programming423
I know my previous post of pageviews may be part of the answer.. But what im

looking for is checking usage of our website.. I'd like to know if we are

doing more traffic on a month to month basis and am wondering how can I find

them out ? Anything in the Web logs ? If not, anything else I can put in

place to capture this info ..


-

You can use the logs....if you save them. I have logs saved from 2005 and

can see how the traffic has changed.



I have an article using log parser how to get this information. It uses

unique visitors, but you can of course change it to page views if you want

to.



"Log Parser: Find out how many unique visitors your website has"

www.gafvert.info/notes/log_parser_unique_visitors.htm">www.gafvert.info/notes/log_parser_unique_visitors.htm



Any decent log analyzer can tell your this information as well, using the

log files.



--

Regards,

Kristofer Gafvert

www.gafvert.info/iis/">www.gafvert.info/iis/ - IIS Related Info





"Hassan" <hassan@test.com>skrev i meddelandet

-

My C-ip is all from a single source ? I think its our load balancer. In

that case, I cant find out unique visitors..



What column gives me page views ? I have log parser and want to know what is

the query to use ?



Thanks



"Kristofer Gafvert" <kgafvert@NEWSilopia.com>wrote in message

-

You need to use the cs-uri-stem and extract the extension. You also need to

figure out what is a page, and what is not a page. Below, i have considered

htm, html, asp, aspx and php to be pages. You may have another extension

that is a page (for example cfm for Cold Fusion pages)



The following example should get you started (it may wrap):

C:\Program Files\IIS Resources\Log Parser 2.2>logparser "SELECT date,

COUNT(*) A

S Hits FROM 'c:\data\LogFiles\ilopia\ex*' WHERE

EXTRACT_EXTENSION(TO_LOWERCASE(c

s-uri-stem)) IN ('htm';'html';'asp';'aspx';'php') GROUP BY date ORDER BY

date"



Example output:

2004-12-14 633

2004-12-15 502

2004-12-16 487

2004-12-17 536

2004-12-18 255



I wrote this in hurry so it may have mistakes.



I don't think this will catch default documents. I think they are logged as

a folder name (for example /iis/) and without extension. So you may need to

modify the query to catch this as well (hint: change the WHERE clause to

read NOT IN and exclude the extensions you know are not pages, such as

images, pdf, zip-files etc.)





--

Regards,

Kristofer Gafvert

www.gafvert.info/iis/">www.gafvert.info/iis/ - IIS Related Info





"Hassan" <hassan@test.com>skrev i meddelandet

-

Thanks Kristofer.



On a side note, to your earlier message on capturing unique visitors.. so in

our case our C-IP is our load balancer.. In that case, how does one figure

out unique visitors ? Do you think the load balancers store this info or do

we need to scrape some logs from our edge routers or so ?

Just curious so I can reach out to the right team to get me that info.



Btw, when you get the C-IP, is the IP usually from the ISP that hits your

site or can you get the actual IP for the home computer of the client ? If

its the ISP, do you think that if there are a 1000 users that go through the

same ISP, then you will just see it as one unique visitor for those 1000 end

users ?



Thanks



"Kristofer Gafvert" <kgafvert@NEWSilopia.com>wrote in message

-

I have no idea what your load balancer can offer.



For your other question, it depends. One user may have one IP address or

multiple IP addresses (AOL users for example). One IP address may be one

user, or multiple users (corporate proxys for example).



Furthermore, a user may not even get the page from your server, but instead

from a cache somewhere on the Internet. In that case, you have a "visitor"

without nothing logged, which you obviously cannot track from the log file.



An IP address logged may not even be a user at all, but instead a web spider

crawling your website.



So basically, one IP address logged can mean:

- Zero user

- 1 user

- Multiple users



One user can be logged as:

- Nothing in the log at all

- One IP address

- Multiple IP addresses



See the problem? There is no good way to determine a physical user. Some log

analysers claim they can accurately do this, but i doubt. There are however

different methods to try to identify actual users, by not only using the IP

address and excluding web spiders.



This is an interesting publication:

"Measuring Web Site Usage: Log File Analysis"

epe.lac-bac.gc.ca/100/202/301/netnotes/netnotes-h/notes57.htm">epe.lac-bac.gc.ca/100/202/301/netnotes/netnotes-h/notes57.htm



--

Regards,

Kristofer Gafvert

www.gafvert.info/iis/">www.gafvert.info/iis/ - IIS Related Info





"Hassan" <hassan@test.com>skrev i meddelandet

-

On Dec 26, 11:15=A0am, "Kristofer Gafvert" <kgafv...@NEWSilopia.com>

wrote:

-

You have to first define "unique visitors". Or find yourself a web

traffic analysis package and use its definition.



As you are noting, using client IP is not exactly reliable since many

network elements between client and server can proxy the request and

mask the true IP. And you may not have control of all the responsible

network elements.





//David

w3-4u.blogspot.com">w3-4u.blogspot.com

blogs.msdn.com/David.Wang">blogs.msdn.com/David.Wang

//









On Dec 26, 10:36=A0am, "Hassan" <has...@test.com>wrote:

-