Issues with SMS Connectivity to Mongo gives AuthenticationFailed error in Netwitness

Issue

The rsa-sms service fails to start, throwing connection issues with mongo and results in Netwitness UI down.

 2020-06-24 05:49:42,662 [WrapperSimpleAppMain] ERROR com.rsa.netwitness.sms.common.mongo.config.MongoDbConfiguration - MongoDB Server is unreachable. Please check if mongod service is running.
 
[conn167] SCRAM-SHA-1 authentication failed for les on les from client 10.68.136.100:39844 ; AuthenticationFailed: SCRAM-SHA-1 authentication failed, storedKey mismatch

 Caused by: org.springframework.dao.PermissionDeniedDataAccessException:{ "serverUsed" : "c871f375-3700-4a09-ae04-695f864fdc8d:27017" , "ok" : 0.0 , "errmsg" : "Authentication failed." , "code" : 18 , "codeName" : "AuthenticationFailed"}

Resolution

Please follow below steps node 0:-

1. Stop sms service

 service rsa-sms stop

2. Remove the mongo.properties file

 rm -rf /etc/netwitness/platform/legacy_mongo/rsa-sms-server.mongodb.properties

3. Remove the existing roles for sms/esm/les/asg from the mongo, by login to Mongo using deploy_admin credentials

 mongo admin -u deploy_admin
 
use admin
 
> db.system.users.deleteOne({"_id" : "les.les"})
 
{ "acknowledged" : true, "deletedCount" : 1 }
 
> db.system.users.deleteOne({"_id" : "sms.sms"})
 
{ "acknowledged" : true, "deletedCount" : 1 }
 
> db.system.users.deleteOne({"_id" : "esm.esm"})
 
{ "acknowledged" : true, "deletedCount" : 1 }
 
> db.system.users.deleteOne({"_id" : "asg.asg"})
 
{ "acknowledged" : true, "deletedCount" : 1 }

4. Run the sms cookbook

 chef-client -r "recipe[rsa-sms-server::config]" --config /var/lib/netwitness/config-management/client.rb --json-attributes /etc/netwitness/config-management/node.json

5. Replace the UUID with localhost IP ie, 127.0.0.1 in the mongo configuration files under "/opt/rsa/sms/conf"

 /opt/rsa/sms/conf/smsMongoDbConfig.json 
 
/opt/rsa/sms/conf/esmMongoDbConfig.json
 
/opt/rsa/sms/conf/lesMongoDbConfig.json
 
/opt/rsa/sms/conf/asgMongoDbConfig.json

6. Replace the UUID from file "/opt/rsa/sms/mongodb.properties"

 vi /opt/rsa/sms/mongodb.properties
 
:%s/<UUID>/127.0.0.1/gc

7. Start the sms service

 service rsa-sms start

Product Details

RSA Product Set: NetWitness Platform
RSA Product/Service Type: Admin-Server, Health & Wellness
RSA Version/Condition: 11.x

Approval Reviewer Queue

Technical approval queue