Thursday, 16 April 2009

What is data mining?

After a couple of posts about coal and diamonds I thought it might be a good idea to post a straightforward answer to the question: What is data mining?

Data mining is the applications of statistical techniques and artificial intelligence to find patterns in data that are not apparent using queries or other database techniques. Data patterns can provide insights into behaviours and trends that would otherwise remain hidden. Data mining is perhaps more descriptively known as knowledge discovery in data.

The statistical techniques are run as software programmes which allow parameters to define how the algorithms are applied. The pattern-finding process can be run on different data sets and with different parameter settings. Models can be refined to improve the accuracy of the results.

Although data mining algorithms can be run on any data file, they are often applied to files where data has been brought together from a number of different sources. Different statistical techniques, or algorithms, are suited to different types of data, and different problems.

The basic premise of data mining is that predictions can be made about the future from a sample of past behaviour, ie the existing data files. For example, theatre bookings together with other information about those who made the bookings can be used to find patterns, and predict what type of productions they might book in the future. Segments can be found and different marketing messages sent to them according to their profile.

Data mining is the automatic or semi automatic means of finding patterns and making predictions.

Data mining has now been built into Microsoft’s SQL Server database: starting with two algorithms in SQL Server 2000, extended to 7 algorithms in SQL Server 2005, and with some further enhancements in SQL Server 2008.

Get in touch if you would like to find out whether your data files are suitable for data mining.


  1. offers Paving Contractor, Parking Lot Repairs, sealing, striping, Oil and Stone Driveways at Riverhead NY, Quogue NY, Hamptons NY, Southampton NY, Sag Harbor NY, Green point NY, Wading River NY, East Moriches NY, Center Moriches NY, Mannorville NY, Miller Place NY , Mt. Sinai NY,Greenport NY

  2. offers Commercial Paving, Asphalt Contractor, and Parking Lot Resurfacing at Queens NY, Nassau County, Bayside NY, Jamaica NY, Middle Village NY, Ozone Park NY, Howard Beach NY, Little Neck NY

  3. offers Grading, Excavation and Paving Contractor, Land Clearing Services, Septic Systems, Retaining Walls and Driveways, Drainage Systems, Construction Site Clean-Up, Demolition Contractor at Walhalla SC, Seneca SC

  4. offers Bed Bug Exterminator, Bed Bug Inspections, Bed Bug Elimination, Bed Bug Inspection for Hotels and Residential and Commercial Bed Bug at Palo Alto CA, San Mateo CA, San Jose CA, Belmont CA, San francisco CA, Redwood City CA, Sunnyvale CA

  5. offers Parking lot paving, walk way construction, Commercial paving, asphalt, Parking Lot Repairs, Parking Lot Striping, Commercial Blacktop, Parking Lot Repairs, Commercial Paving Contractor, Commercial Asphalt Contractor at New Jersey at Hanover NJ, East Orange NJ, Newark NJ, Morristown NJ, Summit NJ , Union NJ, Hackensack NJ, Patterson NJ

  6. offers Pest Control, Exterminator, Rodent Control, Rodent Elimination, and Pest Elimination at Palo Alto CA, San Mateo CA, San Francisco CA, Redwood City CA, Sunnyvale CA, and Belmont CA

  7. Divorce Attorney, Female Divorce Attorneys and Long Island Divorce Attorneys, Long Island Female Divorce Attorneys

  8. offers Mobile paper shredding, Mobile hard drive destruction at Hauppauge NY, Suffolk County NY, Long Island NY, Ronkonkoma NY, Melville NY, Huntington NY, Garden City NY, Farmingdale NY, Westbury NY, Bohemia NY, Stony Brook NY, Nassau County NY