Web Wiz Guide's Site Searcher Script modified as a file content indexer to produce pipe-delimited csv output


UPDATED VERSION

THANK-YOU to Vladimir Miho for his logging script that creates the csv file from the output: http://planet-source-code.com/vb/scripts/showcode.asp?lngWId=4&txtCodeId=8911

I used the search script to index the content of html horse pedigree files with pipe-delimited csv output. I imported the csv files
into Access and now have the file contents in my pedigrees database and database-searchable, which is faster and
less server intensive.

The idea was to get the text content of the html files entered into my database. You see, my community pedigree files collection consists mostly of html files. It was easy enough to get basic information about each file entered into the Access database, such as file size, date uploaded, file name, and so on. What I really wanted in the database was the CONTENT of each file. This is because if I used a file system object search script like Web Wiz Guide's, to search the content of the files, it just took too long to grind through about 650 (and growing) files. By getting the file contents into the Access database, searches of the content are therefore greatly speeded up, especially for our community members who have slow computers or who are on dialup.

View another example: pipe-delimited csv formatted text file.
Here is an example of the pipe-delimited csv formatted results that the script gave me:

583|tiegste.htm|(c) 1999, AQHA. All Rights Reserved. 4 GENERATION RACE/SHOW PEDIGREE|There is no description available for this page| 339|Tuesday, August 20, 2002|14| (c) 1999, AQHA. All Rights Reserved. 4 GENERATION RACE/SHOW PEDIGREE A.newslink { COLOR: blue; FONT-FAMILY: arial; FONT-SIZE: 9pt; FONT-STYLE: normal; FONT-WEIGHT: bold; LINE-HEIGHT: 9pt; TEXT-ALIGN: left; TEXT-DECORATION: none } A:hover { COLOR: maroon } A:link { COLOR: navy; TEXT-DECORATION: underline } "); //--> Tiegs Te 2416842 1985 chestnut mare S.I.: 0 Starts: 0 Wins: 0 2nds: 0 3rds: 0 Earnings: 0 Hlt Pts: 11.0 Perf Pts: 7.0 SIRE side of pedigree Azure Te (TB) 1962      T0052758 bay        Nashville (TB) 1954      T0061755 bay        TE n' Te 1973       1135492 bay      H- 22.0  P- 0.0 Blue One (TB) 1952      T0152831 bay        Vila 1960       0137530 brown      H- 5.0  P- 0.0 Leon Bars 1954       0072126 sorrel      H- 0.0  P- 1.0 Skipalindas Te 1981       1712355 sorrel      H- 43.0  P- 0.0 Fairy Adams 1949       0030302 bay        Eternal Ben 1963       0300267 sorrel      H- 33.0  P- 14.5 Eternal Sun 1958       0151802 sorrel 95 12 2 1 1 $ 1,676    H- 41.0  P- 0.0 Skipalinda 1973       0987469 chestnut      H- 46.0  P- 110.0 Benetta Bar 1959       0104107 dun        Bar Y Skippa 1961       0170623 palomino        Skipper Jr 1951       0040514 sorrel      H- 17.0  P- 9.0 Bar Y Lady 8 1942       0005054 dun        DAM side of pedigree Torino 1967       0497174 sorrel      H- 55.0  P- 39.0 Ledo Bars 1963       0281380 sorrel      H- 29.0  P- 0.0 The Continental 1971       0739908 red roan      H- 34.0  P- 18.0 Rita Blue 1961       0160022 bay        Frosty Money 1963       0281133 roan      H- 157.0  P- 15.5 Jimmy Mac Bee 1958       0092825 dun      H- 1.0  P- 0.0 Cheryl Tiegs 1978       1385900 sorrel      H- 51.0  P- 1.0 Red Dee Money 1958       0093048 roan      H- 7.0  P- 0.0 Pute Cee Bonanza 1964       0431937 bay      H- 28.0  P- 21.5 Coy's Bonanza 1959       0143099 sorrel 85 16 1 3 2 $ 289    H- 154.0  P- 7.5 Kim's Bonanza 1968       0611925 bay      H- 48.0  P- 0.0 Zon-Zoe (TB) 1959      T0067332 bay        Trixie Snipper 1964       0306773 sorrel      H- 22.0  P- 14.0 Little Feller 1955       0051631 bay      H- 1.0  P- 0.0 Miss Snipper 1956       0086123 bay        "); //--> (c) 1999, AQHA. All Rights Reserved. 4 GENERATION RACE/SHOW PEDIGREE

187|frecklessanpeppy.jpg|No Title|There is no description available for this page| 337|Monday, August 19, 2002|37|

190|FrostedDoc.htm|PEDIGREE RECORD 2003, AQHA. All Rights Reserved.|There is no description available for this page| 335|Sunday, June 01, 2003|8| PEDIGREE RECORD 2003, AQHA. All Rights Reserved. .page { PAGE-BREAK-AFTER: always } .page2 { PAGE-BREAK-AFTER: always } Frosted Doc 2498066 1986 red roan stallion SI: 0 Starts 0 Wins: 0 2nds: 0 3rds: 0 Earnings: 0 Hlt Pts: 0 Perf Pts: 0 SIRE side of pedigree Doc Bar 1956       0076136 chestnut 75 4 0 0 1 $ 95    H- 36.0  P- 0.0 Lightning Bar 1951       0037566 sorrel 95 10 4 3 1 $ 1,491    H- 18.0  P- 0.0 Mr Senbar 1968       0542728 bay      H- 0.0  P- 51.0 Dandy Doll 1948       0026556 chestnut 85 21 5 2 3 $ 876    H- 0.0  P- 1.5 Miss Sen Sen 1947       0024153 bay 85 44 7 7 3 $ 4,538      Okie Smokie 1       U0077226 n/a        Mr Senjell 1978       1416170 buckskin        Miss El Peco 1943       0010040 chestnut 75 7 2 3 0 $ 28      Barjo 1949       0032673 chestnut 95 78 21 20 12 $ 11,573      Three Bars (TB) 1940      T0065983 chestnut        Barjelle 1961       0184878 buckskin 95 61 11 11 8 $ 8,509      Betty Joe 1940       0000831 bay        Hancock Belle 1944       0005593 dun        Buck 8       U0240700 n/a        Miss Hancock 1       U0076388 n/a        DAM side of pedigree Doc's Gold Mine 1969       0697898 palomino      H- 7.0  P- 19.0 Doc Bar 1956       0076136 chestnut 75 4 0 0 1 $ 95    H- 36.0  P- 0.0 Gold Mine Sonny 1976       1221717 palomino        Saucy Bess 1957       0081082 palomino      H- 78.0  P- 10.0 Konspikuus 1956       0071418 sorrel        Poco Shade 1951       0048114 dun      H- 2.0  P- 11.5 Docs Candy Cat 1980       1676284 red roan        Sheffieldpeachescrea 1948       0028710 roan        Sugar Bars 1951       0042606 sorrel 95 30 7 4 7 $ 3,166    H- 2.0  P- 0.0 Three Bars (TB) 1940      T0065983 chestnut        Sugar Bar Lil 1961       0163407 bay        Frontera Sugar 1943       0005731 palomino        Pond Lillie 1949       0044388 gray        Pondfly 1945       0011636 dun        J a Mare 1       U0072561 n/a          --> 1 PEDIGREE RECORD 2003, AQHA. All Rights Reserved.
 


I used pipe delimiters to make csv format.
I made the search input text box hidden and made the value an asterisk
"*" because that is traditional for wildcard.  I removed the code that would show if no results were found, so that by default, the script shows everything it reads.

 I used the variable intNumFilesShown as the primary key for each record when imported into Access.
The script will simultaneously and automatically
create a csv file from the output.

Html and carriage returns and line feeds and blank spaces are filtered out.

I used it to index just under 700 pedigree html files. It took quite a while for the script to grind through that many files. When I index files again, I will set the script to index only the new files. If you have a large number of files, you may want to set the script to do only a certain number at a time...I would have to study up on how to make it work that way. Maybe you can tell me how. :)

I would be grateful for suggestions on how to improve this, or if someone else would take the idea and improve it.

I spent HOURS putting this script together. Now that it is done, I think the idea is fairly "simple" but I had to learn how to do some stuff I didn't know how to do before. If you use this script or find it helpful, I would appreciate a rating on www.aspin.com, or send me an email to let me know how you're using it. (As usual, donations to my paypal account are an excellent sign of appreciation.) --Lil

GET CODE
Rated:
by Aspin.com users
What do you think?

 

 

 

  ASP Examples Menu of Active Server Pages scripts code Classic ASP

Classic ASP Active Server Pages Examples, code, tutorials, scriptsASP Examples Menu (below*)



Active Server Pages | ASP | Scripts | Tutorials | Code | Web Programming | Examples
Active Server Pages ASP code examples, tutorials, and snippets for use in Programming interactive websites.

If you find omissions or errors let me know. I have moved these code samples to their own domain; if you find pieces missing, please let me know.
My favorite scripts site is CODANGO.

*

If any the information I've posted here has been useful to you, please donate.

Quick 'n  easy  dirty PHP script code wizard-generator

Zenphoto RSS XML feed used as data source for javascript slide show with PHP

Classic ASP to archive emails into database and save attached files to folder

PHP Image GD for thumbnails and image resizing with pathing for Windows servers

ODBC database connections for Microsoft Access MDB files with Windows 7: solution posted on this forum.

HTML5 embedded video player "Projekktor" completely skinnable with hyperlinked watermark

Edit web.config to allow Windows iis7 server to handle mp4 files or other mime types as needed

URL rewrite or make friendly URLs for iis7 Windows Server 2008 by editing your web.config file

FACEBOOK API GEEWHIZ - INTEGRATE FACEBOOK WITH YOUR WEBSITE

Use PHP to zip folders for backing up a website

Use PHP to archive emails in database and save attached files to folder

Use PHP with json to check how many hits left on Twitter API

PHP get single record from Access database without catchable fatal error message

PHP to make a bot to send automatic Twitter status updates with Abraham Williams' PHP Oauth Twitter Library

A way to use the PHP Oauth Twitter Library with your Classic ASP scripts for sending status updates

Get user's IP address location for your form results

Tutorial for registering an application with Twitter

Update your Twitter status with Classic ASP and Oauth seamlessly and invisibly without having to login to Twitter. Send status updates programmatically from a web page. PHP example too.

CLASSIC ASP: Cache your Twitter tweets in a database to keep your Twitter xml requests within the rate limit of 350 per hour / PHP VERSION

PHP: Use json to fetch Twitter followers' profiles

Index files content and insert into database for faster searches

Classic ASP with Ajax: secure URL check

Classic ASP with Ajax: referer check

Classic ASP with Ajax: a solution to the ampersand problem in querystrings

Very Simple Star Rating System for Classic ASP

Star Rating System uses CSS and JS adapated for Classic ASP from Yvo Schaap PHP script

XMLhttp with ASP to fetch and save photos from Photobucket account through RSS XML. Can be adapted for Youtube videos to import data to database.

NET image resize can be used to make thumbnails for Classic ASP

Track site visitors, get their ip address geographical data, count page views with Classic ASP

Javascript slideshow with Classic ASP to load image details dynamically from database photos table

Classic ASP with Ajax for rotating banners without page refresh and XML file converted to recordset as banner database
--Variation of the above but fetching a REMOTE XML file as the database
--Variation checks for secure URL and builds absolute URL and makes offsite banner links open in new window

True inline edit Classic ASP datagrid table database edit updating with Ajax SIMPLE EASY without page refresh!

Use Ajax with Classic ASP to preview data then update form with javascript url write

Yvo Schaap's easy inline edit Ajax: an example of using it to inline edit multiple rows of records in Classic ASP

Use Classic ASP to send text messages SMS from your website (Also shows how to use xmlhttp to post form data)

Ajax with Classic ASP for seamless, no page reload database record insertion

Nested SQL Statements to make temporary column names

Multiple records per row with paging

Display multiple records per row

Get ID of newly inserted record, Classic ASP, Access Database

Javascript timer with ASP to keep track of time expired until login expires / timeout session is up

Multiple Javascript event functions triggered from single form onsubmit

Get Querystring key names along with querystring variables

These are out of date but may still be of interest:

ASP Youtube Downloader  Version FOUR
All ASP code. Allows user client side downloads of Youtube videos. You have the option to allow files to be saved directly to your site also.
ASP/PHP video downloader (Works better than ASP for large files)

Use ASP to dynamically parse a Youtube XML playlist to render to html.

Zip up an archive file of your site for backup if you need to restore website with ASP and free Zip Component.

Zip all files in a folder into an archive or backup file dynamically by specific file extension.

Sanitize or clean price cost field for database insertion or display.

Javascript image dimensions and image file size preview.

Put recordset into array, assign keys to the records then use record associated with specific array key as a variable elsewhere.

Access Database Interface Generator Wizard to read your table and field names and to create a table display.

Combining dropdown selection box menu with dynamic ASP database page.

How to redirect user to original page they tried to view before logging, after they are logged in.

Previous/Current/Next Records, or Buddy Ring Script

Custom ASP 404 page not found error script: can also be used for URL rewriting

ASP Example: Combine ASP with Javascript for popup windows
dynamically sized to image dimensions.

ASP Example: How to use ASPJPEG to create thumbnails
Click for free Highly recommended thumbnailer for which you don't need Server access (doesn't seem to work on Windows Server 2008)

ASPjpeg: How to re-scale aspect ratio of thumbnails by height instead of width.

ASP Example: What if your host has an older version of ASPJPEG that doesn't support gifs?

Select Count Distinct Records for Access Database

Upload Image to folder and insert filename into database

Get date in such a way that it can be made part of a file name

Isolate a file name away from its path or extension or strip a path from a file name or strip characters from database field

User-customized on-the-fly stylesheet css files

Enhanced Page Hits Counter (also counts downloads and menu link hits)

Loop through array and compare to string with select case

Aphabetical Paging for your ASP scripts

Web Wiz Guide's Site Searcher Script modified as a file content indexer

Let Users Select How Many Records to View

Access Database for your PayPal IPN scripts

Miscellaneous collected code

From Classic ASP to PHP

You don't have to be a genius, just persistent, to write original Active Server Pages scripts

BuildApp - great old Classic ASP script generator!

Software Recommendation: bare_bones_no_bells_and_whistles_asp_code_generator_database_interface_maker (For PHP I recommend EasyGen.)

If any of this information is helpful to you, please consider donating with the button below. Thanks! ~~Lil