All Articles

Dear fake users – who does Google think you are?

Dear fake users – who does Google think you are?

Summary Google Analytics is rife with Fake or Ghost referrers, this post takes a look at how Google itself classifies these users by Age, Sex, Interests etc Anyone with a website that uses Google Analytics must have noticed quite a bit of traffic coming from “Referrals”. Some of the sites, whose names keep changing every […]

A Dash button for everything – Amazon has 163 dash buttons now

A Dash button for everything – Amazon has 163 dash buttons now

Amazon has ventured into some areas like the Dash buttons or the Echo which have a niche use. The Dash buttons let you replenish items from the Amazon store with the click of a button ! We decided to take a look at how many products you can order with their own exclusive Dash button […]

Amazon India vs Flipkart vs SnapDeal

Amazon India vs Flipkart vs SnapDeal

The India eCommerce market is going through a lot of growth. A largely untapped market due to the lack of infrastructure – logistics, electronic payments, shipping and cultural opposition to eCommerce has seen a huge uptick in acceptance and sales over the past few years. The large eCommerce players all publish various statistics on who […]

An API for every site using web scraping

An API for every site using web scraping

There is a lot of content available on the millions of websites on the Internet, and all of them involve some amount of programming to get them there, however, to get to all this content using a programmatic API isn’t really possible. If you need data scraped from a website in a specific format in […]

CHART: Count of Products in Amazon.com for Top 10 categories – May 2016

CHART: Count of Products in Amazon.com for Top 10 categories – May 2016

The chart and tables below show the number of products in the Top 10 categories sold by Amazon.com. The previous data can be found here. There has been approximately an increase of 100,000 products since last year and a decrease of 100,000 products since last month. Electronics          118,328,809 Cell Phones & Accessories            79,174,534 Home & […]

XPaths and their relevance in Web Scraping

XPaths and their relevance in Web Scraping

XPath (XML Path Language) is a syntax for defining parts of an XML document. We will explain the relevance of Xpath in web scraping. XPath is a query language for identifying and selecting nodes or elements in an XML document using a tree like representation of the document. XPath was defined by the World Wide […]

Books sold by language on Amazon

Books sold by language on Amazon

We decided to have a look at Amazon.com books and see if it discriminates (ok maybe that is a harsh word) by language.   They, of course, don’t write these books – they just sell them. They are US headquartered and it is almost obvious that a majority of their books are probably written in […]

Demise of Kimono Labs and the fate of their users

Demise of Kimono Labs and the fate of their users

We have written about the differences between a free service and a paid web scraping service previously. Unfortunately, the 125,000 claimed “users” of Kimono Labs woke up to the rude realities of such a free web scraping service. Kimono Labs, got acquired by Palantir and gave their “beloved users” just 2 weeks to find an […]

Amazon.com statistics February 2016

Amazon.com statistics February 2016

Here are some stats from Amazon.com Total Products sold on Amazon.com = 473,578,572 35,158,862 products are Prime Eligible 31,197,636 items Ship for Free by Amazon 21,317,553 items are Amazon Global shipping Eligible 9,690 items are Prime Pantry items 39,944,324 items are Used 14,723,626 items have a 4 Stars & Up review rating  

Super Bowl 50 – Sentiment analysis of #SuperBowlSunday

Super Bowl 50 – Sentiment analysis of #SuperBowlSunday

We decided to take a look at Twitter for the Super Bowl 50 between the Panthers and the Broncos and monitor the hashtag #SuperBowlSunday, before during and after the game. We monitored 33,000 tweets and they came from 27,433 unique users, so obviously we had some users who were really into it and a lot […]

Amazon Total products sold January 2016

Amazon Total products sold January 2016

The number of products sold by Amazon has increased slightly from October and as of now the count stands at 489.5 million products. This is a slight increase from the 467 million products sold in October almost back to the 485 million products in July.

Gift Cards sold on Amazon – by the numbers – a whole lot of card data

Gift Cards sold on Amazon – by the numbers – a whole lot of card data

It is that time of the year again as you look at your holiday gift list and wonder what you buy for some of the people on your list. An ugly holiday sweater maybe? Maybe not. If you have walked miles and miles through malls and specialty gift stores and are about to give up, […]

Turn the Internet into meaningful, structured and usable data