Sunday, December 12, 2004

What's On

There are times when I just want to scream!!!

Just trying to match up venues with listings on a weekly basis is enough of a challenge. The level of challenge increases when you consider that the external data supplier may or may not alter their internal identifiers for venues. We have already encountered situations where identifiers have been reused on different venues.

Still, soldiering on, into the home stretch now. Suprisingly the whole thing is starting to come together and provides fairly decent performance. The new site will look grand, and will be different from any mapping site I've seen 'out there'.

The basic design of the database has stood up well to all the abuses that have been heaped on it as data not intended to be stored in this structure was squeezed into contortions to fit the design and still provide acceptable performance.

With the help of SDO_TUNE and a distinct lack of documentation (anywhere), I've managed to increase performance of many features within SPATIAL. Working from a position of no baseline performance to aim for, I've had to set and tune parameters based on feeling and observed performance and the results have been impressive.

Until the next time.........

Saturday, December 04, 2004

Exstensible Madness Language

Can't help but admire the guys (and gals) who designed XML. They have made a beast of a nightmare come true. When it works, it works really well, but when it doesn't..., well then the hair pulling starts.

Oracle have provided us with some lovely tools to generate and post XML direct from a SQL query, and with some tinkering with the lesser known features we actually got the thing to work. Now all we have to do is repeat the same thing many times over for searches scattered throughout the system (the consistent scatter-gun approach).

I am seriously considering modularising the entire back-end and giving it a more generic class like structure, though how this will affect performance is in the hands of the gods. My first attempts have been promising (so far), using the database design and key data to auto generate queries etc.... I'll keep you posted.

As for the spatial side of things - well, performance was suffering, as was my downtime, until I found some useful hints from others in the same situation. They pointed me towards some valuable performance enhancing methods for getting the most out of Spatial.