topic Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality in Qlik Replicate

Replicate UI doesn't start correctly, have to server rebuild to restore functionality

kyhutch_mdb — Tue, 11 Oct 2022 15:42:26 GMT

When using CentOS7 after restarting a server the Replicate UI does not start up correctly. When running the areplicate status command it returns the first line in the output file attached to this ticket.

However, when I run ps -ef | grep -i rep I see lines 3-7 in the output file attached to this ticket.

When everything is working well I would only see the 2 repctl lines. Anytime that I've seen more than just the 2 repctl lines I have had to do a full server rebuild to get a functioning replicate instance. I feel like there is something I'm missing, but I haven't been able to find enough information to continue troubleshooting this.

Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality

Dana_Baldwin — Tue, 11 Oct 2022 16:51:01 GMT

Hi @kyhutch_mdb

Is this a consistent error, where the Replicate installation only works until you reboot the server, then has to be reinstalled? Have you always had this issue on this server, or is this something new? If so, when did it start, and were there any changes to Replicate/Server/Source/Target when it started?

Thanks,

Dana

Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality

kyhutch_mdb — Tue, 11 Oct 2022 17:53:17 GMT

@Dana_Baldwin Thank you for the quick response. This has been a consistent error for me. I have only recently started to test out the product and have run into this a few times. I was hoping it was a user error issue (it still may be) but I need help figuring out what the cause is.

Sadly I've had this issue on multiple servers. I'm using virtualized servers, so it's easy to create new ones. As far as the steps to replicate go.

I install and set up Qlik replicate and am able to use it
I use systemctl stop areplicate to stop the service
I shutdown the server for at least a couple hours
I bring the server back online

That's when I run into the scenario where the service doesn't start up correctly/completely and I see the call to /bin/bash ./rependctl.sh and a java process sitting in the ps -ef output.

Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality

kyhutch_mdb — Tue, 11 Oct 2022 18:12:50 GMT

I realized I've left out some crucial information. I have installed the software on CentOS7 and am using Qlik Replicate version 2022.05.0-499.

Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality

kyhutch_mdb — Tue, 11 Oct 2022 20:53:36 GMT

Is there a way to check the status of the web console besides running the areplicate status command?

Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality

KellyHobson — Tue, 11 Oct 2022 21:58:54 GMT

Hey @kyhutch_mdb ,

From your steps listed above, can you try stopping the service with this command instead:

/opt/attunity/replicate/bin/areplicate stop

We do not advise customers to stop/start the service with systemctl commands.

Additional doc for reference.

Let us know if you are still experiencing the issues with start up.

Best,

Kelly

Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality

kyhutch_mdb — Tue, 11 Oct 2022 22:23:29 GMT

@KellyHobson

Thank you so much, that fixed it.

Do you recommend that I disable the areplicate service? If so, how can I make sure that the Replicate program auto-starts when the server boots up?

Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality

Heinvandenheuvel — Wed, 12 Oct 2022 13:40:59 GMT

No, you should not disable the service. The service is 'the program' the service spawns tasks as needed. The tasks are independent programs 'under' the service.

fwiw,

Hein

Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality

KellyHobson — Wed, 12 Oct 2022 14:14:51 GMT

Hey @kyhutch_mdb ,

Great! Glad to hear. Agree with @Heinvandenheuvel , I would not disable the service.

Do you have an areplicate listing under /etc/init.d/?

Kelly

Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality

kyhutch_mdb — Wed, 12 Oct 2022 17:56:55 GMT

Yes, there is an areplicate in /etc/init.d/. I did a standard install of the RPM, so that was created as part of it.

To be clear, when I said disable the service I meant run a systemctl disable areplicate, since this didn't seem to start up correctly. That way I would just run the /opt/attunity/replicate/bin/areplicate start|stop command to get the service to start properly, since the systemctl start seems to cause issues.

Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality

kyhutch_mdb — Wed, 12 Oct 2022 20:40:02 GMT

@KellyHobson hmm, the issue is happening again. After I started up the server I had replicate installed on, and let the service be auto-started by the server, I noticed I couldn't access the web UI. Here is what I'm seeing when I run ps -ef | grep -i rep

attunity 3111 1 0 20:23 ? 00:00:00 /opt/attunity/replicate/bin/repctl -d /opt/attunity/replicate/data service start port=3550 rest_port=3552
attunity 3112 3111 0 20:23 ? 00:00:00 /opt/attunity/replicate/bin/repctl -d /opt/attunity/replicate/data service start port=3550 rest_port=3552
attunity 3116 3112 0 20:23 ? 00:00:00 /bin/bash ./rependctl.sh -d /opt/attunity/replicate/data/endpoint_srv/data -plugins rependsrv server setadminpassword 2F1AB838025819CBA262F0403F0105403624FFB5134A9EB183956B40ACB6B25C 2F1AB838025819CBA262F0403F0105403624FFB5134A9EB183956B40ACB6B25C
attunity 3120 3116 4 20:23 ? 00:00:08 /opt/attunity/replicate/endpoint_srv/bin/../../jvm/bin/java -XX:+UseG1GC -Dfile.encoding=UTF-8 -cp /opt/attunity/replicate/endpoint_srv/bin/../externals/*:/opt/attunity/replicate/endpoint_srv/bin/../lib/* com.attunity.infrastructure.server.PluginServer -d /opt/attunity/replicate/endpoint_srv/bin/../data -plugins rependsrv -d /opt/attunity/replicate/data/endpoint_srv/data -plugins rependsrv server setadminpassword 2F1AB838025819CBA262F0403F0105403624FFB5134A9EB183956B40ACB6B25C 2F1AB838025819CBA262F0403F0105403624FFB5134A9EB183956B40ACB6B25C

What's different here and the previous output I shared is the command wasn't running setadminpassword with a hashed password value after it.

Earlier when I ran /opt/attunity/replicate/bin/areplicate stop
I got a response of "Failed to stop service". I have just tried running the stop command recently, after running the start, and it has been running for over 5 minutes, but has not completed yet.

Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality

kyhutch_mdb — Wed, 12 Oct 2022 20:45:15 GMT

@KellyHobson I'm attaching a log file, because it looks like something got messed up, and it might help us figure out what.

Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality

shstanford — Wed, 30 Nov 2022 00:18:49 GMT

I'm seeing the same thing. Did you ever get a resolution to this issue?

Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality

KellyHobson — Wed, 30 Nov 2022 18:56:22 GMT

Hey @shstanford ,

Are you stop/starting the service with these commands?

/opt/attunity/replicate/bin/areplicate start

/opt/attunity/replicate/bin/areplicate stop

Thanks,

Kelly

Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality

shstanford — Wed, 30 Nov 2022 21:03:46 GMT

Yes that's how I'm starting and stopping the services.

Re: Replicate UI doesn't start correctly, have to server rebuild to restore functionality

KellyHobson — Thu, 01 Dec 2022 14:14:26 GMT

Hey @shstanford ,

After a manual stop and start, are you able to access your Replicate UI? The issue on this particular environment was slow response times in a AWS EC2 instance. The Replicate UI eventually came up, but it took 15-20 mins.

Thanks,

Kelly