Re: dev Digest, Vol 135, Issue 9

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Re: dev Digest, Vol 135, Issue 9

kkarra@stanford.edu
Thanks all for sharing what procedure you follow. I include 'solr restart’ during build because I have noticed the process dies every so often if you don’t restart periodically. I never had to recreate cores so far, just followed the suggestion in stackoverflow and it worked. I obviously didn’t spend too much time trying to figure if they indeed disappeared or not, assumed solr would complain if a core by the same name already exists. Am sure it was a coincidence with upgrade.


> On Oct 28, 2020, at 5:00 AM, [hidden email] wrote:
>
> Send dev mailing list submissions to
> [hidden email]
>
> To subscribe or unsubscribe via the World Wide Web, visit
> https://lists.intermine.org/mailman/listinfo/dev
> or, via email, send a message with subject or body 'help' to
> [hidden email]
>
> You can reach the person managing the list at
> [hidden email]
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of dev digest..."
>
>
> Today's Topics:
>
>   1. Re: Solr after 4.2.0 upgrade ([hidden email])
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Wed, 28 Oct 2020 11:11:29 +0000
> From: [hidden email]
> To: Paulo Nuin <[hidden email]>
> Cc: Kalpana Karra <[hidden email]>, [hidden email]
> Subject: Re: [InterMine Dev] Solr after 4.2.0 upgrade
> Message-ID: <[hidden email]>
> Content-Type: text/plain; charset=UTF-8; format=flowed
>
> Dear Kalpana,
> thanks for sharing the issue and the solution :)
> I do not think that the issue is related to the intermine version.
> The Autocomplete and SolrIndexHandler java classes (which are called
> during the postpocess) only delete previuos indexes, see here:
> solrClient.deleteByQuery("*:*");
> solrClient.commit();
> not the cores which need to be created manually -only once- after
> installing solr or any new version of solr.
> Have you installed a new version of solr?
> Please, let us know, if this happens again (hopefully not!)
>
> Thanks for sharing,
> Daniela
>
>> Hi
>>
>> I copy over the cores from dev to production with every new build
>>
>> Cheers
>>
>> Paulo
>>
>> Sent from my iPhone
>>
>>> On Oct 27, 2020, at 17:29, Sam Hokin <[hidden email]> wrote:
>>>
>>> I think I had to recreate my "cores" when I went from 7.7.3 to 8.6.2
>>> as well.
>>>
>>>> On 10/27/20 4:20 PM, Kalpana Karra wrote:
>>>> In case it is of use to others, after upgrading to 4.2.0 keyword
>>>> search was broken throwing this error
>>>> Expected mime type application/octet-stream but got text/html. <html>
>>>> <head>
>>>> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
>>>> <title>Error 404 Not Found</title>
>>>> </head>
>>>> <body><h2>HTTP ERROR 404</h2>
>>>> Recreating ‘cores’ in solr helped solve the problem.
>>>> https://stackoverflow.com/questions/29277972/indexing-documents-using-solr-results-in-expected-mime-type-application-octet-st
>>>> _______________________________________________
>>>> dev mailing list
>>>> [hidden email]
>>>> https://lists.intermine.org/mailman/listinfo/dev
>>> _______________________________________________
>>> dev mailing list
>>> [hidden email]
>>> https://lists.intermine.org/mailman/listinfo/dev
>> _______________________________________________
>> dev mailing list
>> [hidden email]
>> https://lists.intermine.org/mailman/listinfo/dev
>
>
>
> ------------------------------
>
> Subject: Digest Footer
>
> _______________________________________________
> dev mailing list
> [hidden email]
> https://lists.intermine.org/mailman/listinfo/dev
>
>
> ------------------------------
>
> End of dev Digest, Vol 135, Issue 9
> ***********************************

_______________________________________________
dev mailing list
[hidden email]
https://lists.intermine.org/mailman/listinfo/dev
Reply | Threaded
Open this post in threaded view
|

Re: dev Digest, Vol 135, Issue 9

sergio contrino-2
hi kalpana,
just to add that we have some notes about solr shutting down if starved
of memory, so it could be useful to check your memory settings/usage in
your production machine.
thanks
sergio

On 2020-10-28 17:45, Kalpana Karra wrote:

> Thanks all for sharing what procedure you follow. I include 'solr
> restart’ during build because I have noticed the process dies every so
> often if you don’t restart periodically. I never had to recreate cores
> so far, just followed the suggestion in stackoverflow and it worked. I
> obviously didn’t spend too much time trying to figure if they indeed
> disappeared or not, assumed solr would complain if a core by the same
> name already exists. Am sure it was a coincidence with upgrade.
>
>
>> On Oct 28, 2020, at 5:00 AM, [hidden email] wrote:
>>
>> Send dev mailing list submissions to
>> [hidden email]
>>
>> To subscribe or unsubscribe via the World Wide Web, visit
>> https://lists.intermine.org/mailman/listinfo/dev
>> or, via email, send a message with subject or body 'help' to
>> [hidden email]
>>
>> You can reach the person managing the list at
>> [hidden email]
>>
>> When replying, please edit your Subject line so it is more specific
>> than "Re: Contents of dev digest..."
>>
>>
>> Today's Topics:
>>
>>   1. Re: Solr after 4.2.0 upgrade ([hidden email])
>>
>>
>> ----------------------------------------------------------------------
>>
>> Message: 1
>> Date: Wed, 28 Oct 2020 11:11:29 +0000
>> From: [hidden email]
>> To: Paulo Nuin <[hidden email]>
>> Cc: Kalpana Karra <[hidden email]>, [hidden email]
>> Subject: Re: [InterMine Dev] Solr after 4.2.0 upgrade
>> Message-ID: <[hidden email]>
>> Content-Type: text/plain; charset=UTF-8; format=flowed
>>
>> Dear Kalpana,
>> thanks for sharing the issue and the solution :)
>> I do not think that the issue is related to the intermine version.
>> The Autocomplete and SolrIndexHandler java classes (which are called
>> during the postpocess) only delete previuos indexes, see here:
>> solrClient.deleteByQuery("*:*");
>> solrClient.commit();
>> not the cores which need to be created manually -only once- after
>> installing solr or any new version of solr.
>> Have you installed a new version of solr?
>> Please, let us know, if this happens again (hopefully not!)
>>
>> Thanks for sharing,
>> Daniela
>>
>>> Hi
>>>
>>> I copy over the cores from dev to production with every new build
>>>
>>> Cheers
>>>
>>> Paulo
>>>
>>> Sent from my iPhone
>>>
>>>> On Oct 27, 2020, at 17:29, Sam Hokin <[hidden email]> wrote:
>>>>
>>>> I think I had to recreate my "cores" when I went from 7.7.3 to
>>>> 8.6.2
>>>> as well.
>>>>
>>>>> On 10/27/20 4:20 PM, Kalpana Karra wrote:
>>>>> In case it is of use to others, after upgrading to 4.2.0 keyword
>>>>> search was broken throwing this error
>>>>> Expected mime type application/octet-stream but got text/html.
>>>>> <html>
>>>>> <head>
>>>>> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
>>>>> <title>Error 404 Not Found</title>
>>>>> </head>
>>>>> <body><h2>HTTP ERROR 404</h2>
>>>>> Recreating ‘cores’ in solr helped solve the problem.
>>>>> https://stackoverflow.com/questions/29277972/indexing-documents-using-solr-results-in-expected-mime-type-application-octet-st
>>>>> _______________________________________________
>>>>> dev mailing list
>>>>> [hidden email]
>>>>> https://lists.intermine.org/mailman/listinfo/dev
>>>> _______________________________________________
>>>> dev mailing list
>>>> [hidden email]
>>>> https://lists.intermine.org/mailman/listinfo/dev
>>> _______________________________________________
>>> dev mailing list
>>> [hidden email]
>>> https://lists.intermine.org/mailman/listinfo/dev
>>
>>
>>
>> ------------------------------
>>
>> Subject: Digest Footer
>>
>> _______________________________________________
>> dev mailing list
>> [hidden email]
>> https://lists.intermine.org/mailman/listinfo/dev
>>
>>
>> ------------------------------
>>
>> End of dev Digest, Vol 135, Issue 9
>> ***********************************
>
> _______________________________________________
> dev mailing list
> [hidden email]
> https://lists.intermine.org/mailman/listinfo/dev

_______________________________________________
dev mailing list
[hidden email]
https://lists.intermine.org/mailman/listinfo/dev
Reply | Threaded
Open this post in threaded view
|

Re: Solr

Sam Hokin-3
FYI I restart Solr nightly in a cron task. It seems to get "stale." Tomcat as well.

On 11/2/20 5:01 AM, [hidden email] wrote:
> hi kalpana, just to add that we have some notes about solr shutting down if starved of memory, so it could be useful to check
> your memory settings/usage in your production machine. thanks sergio
_______________________________________________
dev mailing list
[hidden email]
https://lists.intermine.org/mailman/listinfo/dev