Ok. So are you saying that you would merge ALL files
(massive lakes,
roads files for example)?
jeff
Traian Stanev wrote:
> Use SDF files. SDF files have a built-in spatial index,
much like the
> SHP spatial index. I have no problems using
multi-gigabyte SDF files
> (containing literally millions of features each).
>
> The FDO SHP provider also creates a spatial index for
SHP files, if you
> choose to not convert them to SDF when publishing to
the server.
>
> Traian
>
>
> -----Original Message-----
> From: mse-users-bounces lists.mapserverfoundation.org
> [mailto:mse-users-bounceslists.mapserverfoundation.org] On Behalf Of
> Jeff McKenna
> Sent: Thursday, January 19, 2006 4:08 PM
> To: mse-users
> Subject: [Mse-users] Efficiently Using Large Datasets
>
> Hello everyone,
>
> As a MapServer (traditional) user, I have a question
for both existing
> MapGuide users and new-school MapGuide Open Source
users.
>
> Forgive me if I am ignorant of MapGuide's abilities,
but when you 'have
> the blinders on' using one software program for a while
you're just not
> aware of how other things work out there.
>
> Let me start by explaining how we deal with large
datasets in MapServer
> (traditional). Imagine trying to use a large dataset,
such as TIGER,
> with several thousand 'lakes' files, remembering that
the web is all
> about speed, and you get the picture of how important
it is to
> efficiently display large datasets. MapServer's native
format is
> shapefiles, so we would normally convert to shapefile,
and then use a
> utility to create a spatial index of the files.
MapServer uses this
> spatial index file to find the locations of all the
individual files
> (such as 'lakes'). It works really well.
>
> I have been asking around and searching on the list for
how to deal with
>
> this for MapGuide Open Source. I have heard rumors
that the SDF format
> is designed for this issue. I have also seen recent
posts about using
> the 'Package Spatial Data' option in Studio. Another
thing that I heard
>
> is that I may have to merge all of the 'lakes' files
into one massive
> file (which scares me because I have also seen posts on
Studio/MapGuide
> problems with large single files).
>
> My question is how do MapGuide users handle this much
data? What is
> recommended?
>
> Thanks very much.
>
> jeff
>
>
--
Jeff McKenna
DM Solutions Group Inc.
http://www.dmsolutions.ca
_______________________________________________
mse-users mailing list
mse-userslists.mapserverfoundation.org
http://lists.mapserverfoundation.org/mailman/list
info/mse-users
|