List Info

Thread: Created: (SOLR-308) Add a field that generates an unique id when you have none in your data t




Created: (SOLR-308) Add a field that generates an unique id when you have none in your data t
country flaguser name
United States
2007-07-18 02:04:07
Add a field that generates an unique id when you have none
in your data to index
------------------------------------------------------------
--------------------

                 Key: SOLR-308
                 URL: https:
//issues.apache.org/jira/browse/SOLR-308
             Project: Solr
          Issue Type: New Feature
          Components: search
            Reporter: Thomas Peuss
            Priority: Minor


This patch adds a field that generates an unique id when you
have no unique id in your data you want to index.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue
online.


Updated: (SOLR-308) Add a field that generates an unique id when you have none in your data t
country flaguser name
United States
2007-07-18 02:06:05
     [ 
https://issues.apache.org/jira/browse/SOLR-308?page=com.atla
ssian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Peuss updated SOLR-308:
------------------------------

    Attachment: GeneratedId.patch

> Add a field that generates an unique id when you have
none in your data to index
>
------------------------------------------------------------
--------------------
>
>                 Key: SOLR-308
>                 URL: https:
//issues.apache.org/jira/browse/SOLR-308
>             Project: Solr
>          Issue Type: New Feature
>          Components: search
>            Reporter: Thomas Peuss
>            Priority: Minor
>         Attachments: GeneratedId.patch
>
>
> This patch adds a field that generates an unique id
when you have no unique id in your data you want to index.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue
online.


Commented: (SOLR-308) Add a field that generates an unique id when you have none in your data
country flaguser name
United States
2007-07-18 04:54:04
    [ https://issues.apache.org/jira/browse/SO
LR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:
comment-tabpanel#action_12513508 ] 

Erik Hatcher commented on SOLR-308:
-----------------------------------

Can the client get the generated id back when adding a
document?

> Add a field that generates an unique id when you have
none in your data to index
>
------------------------------------------------------------
--------------------
>
>                 Key: SOLR-308
>                 URL: https:
//issues.apache.org/jira/browse/SOLR-308
>             Project: Solr
>          Issue Type: New Feature
>          Components: search
>            Reporter: Thomas Peuss
>            Priority: Minor
>         Attachments: GeneratedId.patch
>
>
> This patch adds a field that generates an unique id
when you have no unique id in your data you want to index.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue
online.


Commented: (SOLR-308) Add a field that generates an unique id when you have none in your data
country flaguser name
United States
2007-07-18 08:44:05
    [ https://issues.apache.org/jira/browse/SO
LR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:
comment-tabpanel#action_12513568 ] 

Thomas Peuss commented on SOLR-308:
-----------------------------------

Well, indirectly yes. It is viewable in the response when
you store the field. We use this field because we mainly
rely on 3rd party data where we have not much control of the
data.

> Add a field that generates an unique id when you have
none in your data to index
>
------------------------------------------------------------
--------------------
>
>                 Key: SOLR-308
>                 URL: https:
//issues.apache.org/jira/browse/SOLR-308
>             Project: Solr
>          Issue Type: New Feature
>          Components: search
>            Reporter: Thomas Peuss
>            Priority: Minor
>         Attachments: GeneratedId.patch
>
>
> This patch adds a field that generates an unique id
when you have no unique id in your data you want to index.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue
online.


Commented: (SOLR-308) Add a field that generates an unique id when you have none in your data
country flaguser name
United States
2007-07-18 09:08:05
    [ https://issues.apache.org/jira/browse/SO
LR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:
comment-tabpanel#action_12513582 ] 

Otis Gospodnetic commented on SOLR-308:
---------------------------------------

What type does the id end up being after this?  String?


> Add a field that generates an unique id when you have
none in your data to index
>
------------------------------------------------------------
--------------------
>
>                 Key: SOLR-308
>                 URL: https:
//issues.apache.org/jira/browse/SOLR-308
>             Project: Solr
>          Issue Type: New Feature
>          Components: search
>            Reporter: Thomas Peuss
>            Priority: Minor
>         Attachments: GeneratedId.patch
>
>
> This patch adds a field that generates an unique id
when you have no unique id in your data you want to index.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue
online.


Commented: (SOLR-308) Add a field that generates an unique id when you have none in your data
country flaguser name
United States
2007-07-18 13:03:04
    [ https://issues.apache.org/jira/browse/SO
LR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:
comment-tabpanel#action_12513661 ] 

Hoss Man commented on SOLR-308:
-------------------------------

i'm confused by this issue .. what's the need?

solr doesn't require that you have a uniqueKey field, so if
there isn't a unique id for your data, why add one
artificially?

> Add a field that generates an unique id when you have
none in your data to index
>
------------------------------------------------------------
--------------------
>
>                 Key: SOLR-308
>                 URL: https:
//issues.apache.org/jira/browse/SOLR-308
>             Project: Solr
>          Issue Type: New Feature
>          Components: search
>            Reporter: Thomas Peuss
>            Priority: Minor
>         Attachments: GeneratedId.patch
>
>
> This patch adds a field that generates an unique id
when you have no unique id in your data you want to index.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue
online.


Commented: (SOLR-308) Add a field that generates an unique id when you have none in your data
country flaguser name
United States
2007-07-18 14:59:04
    [ https://issues.apache.org/jira/browse/SO
LR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:
comment-tabpanel#action_12513702 ] 

Ryan McKinley commented on SOLR-308:
------------------------------------

If I'm following correct, this is a FieldType that generates
a UUID regardless of the input value:

	public Field createField(SchemaField field, String
externalVal, float boost) {
		// We ignore the external value and have our own
		return super.createField(field,
UUID.randomUUID().toString(), boost);
	}

What is a use case for that? 

If you are looking for something like the sql auto
increment, it might be a good candidate for the new fangled
'UpdateRequestProcessor' -- this could check if the input
document has a uniqueKey - if not, add one and add the new
value to the response.

> Add a field that generates an unique id when you have
none in your data to index
>
------------------------------------------------------------
--------------------
>
>                 Key: SOLR-308
>                 URL: https:
//issues.apache.org/jira/browse/SOLR-308
>             Project: Solr
>          Issue Type: New Feature
>          Components: search
>            Reporter: Thomas Peuss
>            Priority: Minor
>         Attachments: GeneratedId.patch
>
>
> This patch adds a field that generates an unique id
when you have no unique id in your data you want to index.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue
online.


Commented: (SOLR-308) Add a field that generates an unique id when you have none in your data
country flaguser name
United States
2007-07-19 00:54:04
    [ https://issues.apache.org/jira/browse/SO
LR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:
comment-tabpanel#action_12513817 ] 

Thomas Peuss commented on SOLR-308:
-----------------------------------

The use case is the following:
* We get catalog data from vendors.
* The only unique thing is the catalogid, which is of course
the same for all rows in one catalog.
* In our webapp we request first only a few fields that are
needed for the search result display.
* When the customer clicks on a product in the search result
he gets a detailed page. To get the info from Solr we need a
unique id to read the rest of the fields (50+). This id is
generated by this code.

So you see we need this id only for reference. We do nothing
more with it.

Maybe I overlooked something and this can be achieved with
existing code. Any hint is welcome.

> Add a field that generates an unique id when you have
none in your data to index
>
------------------------------------------------------------
--------------------
>
>                 Key: SOLR-308
>                 URL: https:
//issues.apache.org/jira/browse/SOLR-308
>             Project: Solr
>          Issue Type: New Feature
>          Components: search
>            Reporter: Thomas Peuss
>            Priority: Minor
>         Attachments: GeneratedId.patch
>
>
> This patch adds a field that generates an unique id
when you have no unique id in your data you want to index.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue
online.


Issue Comment Edited: (SOLR-308) Add a field that generates an unique id when you have none i
country flaguser name
United States
2007-07-19 01:06:04
    [ https://issues.apache.org/jira/browse/SO
LR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:
comment-tabpanel#action_12513817 ] 

Thomas Peuss edited comment on SOLR-308 at 7/18/07 11:04
PM:
------------------------------------------------------------
-

The use case is the following:
* We get catalog data from vendors (300+). We have no
control about the data.
* The only unique thing is the catalogid, which is of course
the same for all rows in one catalog.
* In our webapp we request first only a few fields that are
needed for the search result display.
* When the customer clicks on a product in the search result
he gets a detailed page. To get the info from Solr we need a
unique id to read the rest of the fields (50+). This id is
generated by this code.

Of course we could add the unique id in a preprocessing step
but we wanted to achieve this with Solr alone.

The update procedure goes like this:
* Delete all documents with a specific catalogId
* Insert the updated catalog data

So you see we need this id to find the exact same document
we have in the search result. We do nothing more with it.

Maybe I overlooked something and this can be achieved with
existing code. Any hint is welcome.


 was:
The use case is the following:
* We get catalog data from vendors.
* The only unique thing is the catalogid, which is of course
the same for all rows in one catalog.
* In our webapp we request first only a few fields that are
needed for the search result display.
* When the customer clicks on a product in the search result
he gets a detailed page. To get the info from Solr we need a
unique id to read the rest of the fields (50+). This id is
generated by this code.

So you see we need this id only for reference. We do nothing
more with it.

Maybe I overlooked something and this can be achieved with
existing code. Any hint is welcome.

> Add a field that generates an unique id when you have
none in your data to index
>
------------------------------------------------------------
--------------------
>
>                 Key: SOLR-308
>                 URL: https:
//issues.apache.org/jira/browse/SOLR-308
>             Project: Solr
>          Issue Type: New Feature
>          Components: search
>            Reporter: Thomas Peuss
>            Priority: Minor
>         Attachments: GeneratedId.patch
>
>
> This patch adds a field that generates an unique id
when you have no unique id in your data you want to index.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue
online.


Commented: (SOLR-308) Add a field that generates an unique id when you have none in your data
country flaguser name
United States
2007-07-19 08:50:06
    [ https://issues.apache.org/jira/browse/SO
LR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:
comment-tabpanel#action_12513891 ] 

Pieter Berkel commented on SOLR-308:
------------------------------------

>From the usage case you have provided, it sounds like
the unique id will change every time you delete and
re-insert the document.  If this is the case, then perhaps
it might be more efficient to use the lucene document id as
your unique id value rather than a seperate field?  However,
as far as I'm aware, there currently isn't any way to access
the lucene doc id from solr (except perhaps the luke request
handler)?


> Add a field that generates an unique id when you have
none in your data to index
>
------------------------------------------------------------
--------------------
>
>                 Key: SOLR-308
>                 URL: https:
//issues.apache.org/jira/browse/SOLR-308
>             Project: Solr
>          Issue Type: New Feature
>          Components: search
>            Reporter: Thomas Peuss
>            Priority: Minor
>         Attachments: GeneratedId.patch
>
>
> This patch adds a field that generates an unique id
when you have no unique id in your data you want to index.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue
online.


[1-10] [11-20] [21-28]

about | contact  Other archives ( Real Estate discussion Medical topics )