mmcginty
Forums Enthusiast
PetHarbor is pretty cool, but the problem is it limits each query to a 200 mile radius of the entered zip code. I sent them a request for an exemption/permission to query all shelters, but they will almost certainly decline (if they even respond at all.)
Regardless, a consolidated list of every adoptable Sheltie (not including those in rescues) is a worthy goal, it would save a ginormous amount of duplicated effort, and would fill any coverage gaps.
To work around their anticipated refusal, I will to write a program to submit every zip code, "screen scrape" the list of shelters returned for each, and store them in a database table. I'll then filter that data to derive the minimum set of zip codes that must be queried to get all shelters. (There will be many that overlap, as a zip code is generally way smaller than 200 miles.)
Given that minimal list, I can setup a daily composite download that will yield the complete list using the most efficient number of queries.
This may all seem convoluted, but imagine how much collective time/duplicated effort it would save, if we started with a complete list of every adoptable Sheltie in all of PetHarbor, rather than having to go get pieces of it by hand! Yeah, exactly, that's what I'm on about!
Regardless, a consolidated list of every adoptable Sheltie (not including those in rescues) is a worthy goal, it would save a ginormous amount of duplicated effort, and would fill any coverage gaps.
To work around their anticipated refusal, I will to write a program to submit every zip code, "screen scrape" the list of shelters returned for each, and store them in a database table. I'll then filter that data to derive the minimum set of zip codes that must be queried to get all shelters. (There will be many that overlap, as a zip code is generally way smaller than 200 miles.)
Given that minimal list, I can setup a daily composite download that will yield the complete list using the most efficient number of queries.
This may all seem convoluted, but imagine how much collective time/duplicated effort it would save, if we started with a complete list of every adoptable Sheltie in all of PetHarbor, rather than having to go get pieces of it by hand! Yeah, exactly, that's what I'm on about!
