Replicate UI doesn't start correctly, have to server rebuild to restore functionality

[kyhutch_mdb]

When using CentOS7 after restarting a server the Replicate UI does not start up correctly. When running the areplicate status command it returns the first line in the output file attached to this ticket.

However, when I run ps -ef | grep -i rep I see lines 3-7 in the output file attached to this ticket.

When everything is working well I would only see the 2 repctl lines. Anytime that I've seen more than just the 2 repctl lines I have had to do a full server rebuild to get a functioning replicate instance. I feel like there is something I'm missing, but I haven't been able to find enough information to continue troubleshooting this.

[kyhutch_mdb]

@KellyHobson hmm, the issue is happening again. After I started up the server I had replicate installed on, and let the service be auto-started by the server, I noticed I couldn't access the web UI. Here is what I'm seeing when I run ps -ef | grep -i rep

attunity 3111 1 0 20:23 ? 00:00:00 /opt/attunity/replicate/bin/repctl -d /opt/attunity/replicate/data service start port=3550 rest_port=3552
attunity 3112 3111 0 20:23 ? 00:00:00 /opt/attunity/replicate/bin/repctl -d /opt/attunity/replicate/data service start port=3550 rest_port=3552
attunity 3116 3112 0 20:23 ? 00:00:00 /bin/bash ./rependctl.sh -d /opt/attunity/replicate/data/endpoint_srv/data -plugins rependsrv server setadminpassword 2F1AB838025819CBA262F0403F0105403624FFB5134A9EB183956B40ACB6B25C 2F1AB838025819CBA262F0403F0105403624FFB5134A9EB183956B40ACB6B25C
attunity 3120 3116 4 20:23 ? 00:00:08 /opt/attunity/replicate/endpoint_srv/bin/../../jvm/bin/java -XX:+UseG1GC -Dfile.encoding=UTF-8 -cp /opt/attunity/replicate/endpoint_srv/bin/../externals/*:/opt/attunity/replicate/endpoint_srv/bin/../lib/* com.attunity.infrastructure.server.PluginServer -d /opt/attunity/replicate/endpoint_srv/bin/../data -plugins rependsrv -d /opt/attunity/replicate/data/endpoint_srv/data -plugins rependsrv server setadminpassword 2F1AB838025819CBA262F0403F0105403624FFB5134A9EB183956B40ACB6B25C 2F1AB838025819CBA262F0403F0105403624FFB5134A9EB183956B40ACB6B25C

What's different here and the previous output I shared is the command wasn't running setadminpassword with a hashed password value after it.

Earlier when I ran /opt/attunity/replicate/bin/areplicate stop
I got a response of "Failed to stop service". I have just tried running the stop command recently, after running the start, and it has been running for over 5 minutes, but has not completed yet.

[kyhutch_mdb]

@KellyHobson  I'm attaching a log file, because it looks like something got messed up, and it might help us figure out what.

[shstanford]

I'm seeing the same thing. Did you ever get a resolution to this issue?

[KellyHobson]

Hey @shstanford ,

Are you stop/starting the service with these commands?

/opt/attunity/replicate/bin/areplicate start

/opt/attunity/replicate/bin/areplicate stop

Thanks,

Kelly

[shstanford]

Yes that's how I'm starting and stopping the services.

[KellyHobson]

Hey @shstanford ,

After a manual stop and start, are you able to access your Replicate UI? The issue on this particular environment was slow response times in a AWS EC2 instance. The Replicate UI eventually came up, but it took 15-20 mins.

Thanks,

Kelly