Featured

pv issue

This is the post excerpt.

Advertisements

Error: kernel rejection i/o to offline device
https://access.redhat.com/support/cases/#/case/01795198

Linux Real Time Scenarios and issues with their solutions

Scenario:1 On one of my Production SuSE Linux (VMware Virtual Server ) , Storage team has extended partition (RDM disk ) from their end. Now how to rescan that partition and extend without rebooting from the Linux ?

Solution : In My case 8th disk on Controller-1 was extended by the Storage Team.So first rescan it. Using the below Command :

snip

In the above command replace the device info according to your setup.

snip

Now resize the PV using the pvresize Command.

snip

Check the size of Volume Group using vgs command and it should display the new extended size. Using lvextend command we can now easily extend or increase the size of lvm partition.
=============================================================================
Scenario:2 On one of my Linux Server, Oracle database was not running because of tmpfs . Oracle Team wants to extend the tmfs file system size from 2 GB to 4GB.

Solution: tmpfs is a RAM based temporary file system which is generally mounted on /dev/shm. To to extend the tmfs file system use below steps :

Step:1 Check tmfs file system size.

snip

Step:2 Edit the /etc/fstab file.

Change the size as shown below :

snip

Step:3 remount the file system using mount command

snip.PNG

Step:4 Now check the tmfs file system

snip.PNG
==============================================================================
Scenario:3 How to check which disks are used for Oracle ASM in Linux ?

Solution : To display the Oracle ASM disk, use below command :

snip.PNG

To Query a particular disk, use below command

snip.PNG
===================================================================================
Scenario:4 In one of my Linux box , NAS share was mounted on the directory under /archive2015. Space of the NAS share was 150 GB and used size is 137 GB but when we try to create any file or directory we were getting “Disk Quota Exceed” error.

Solution: As it was NAS file system so from the OS perspective we can’t set quota on this. So in my case i contact to Storage team , ask them to check quota limit ( soft quota & Hard quota ). From the Storage Team we got the confirmation that quota limit is set ( Soft quota = 85 % & Hard Quota = 100 % ) and Grace period of 7 Days is also set.

So in our case soft quota limit was reached and no one has reduce the space utilization for 7 Days, so on 8th day Soft Quota limit becomes Hard Quota that’s why we are getting Disk Quota exceed error.
===================================================================================
Scenario:5 For same file system df and du command shows different disk usage.

Solution: This could be because of open file deletion, i.e when someone delete a log file that is being used or open by other process if we try to delete this file then file name will be deleted buts it’s inode and data will not be deleted.

with the help “lsof” command we can determine the deleted files of /var that are still open :

snip

So to release the space , we can kill the command with its PID using kill command.
====================================================================================
Scenario:6 While installing VMware tools on Suse Linux Servers if you get below errors

snip.PNG

Solution :

# zypper install perl-Bootloader

And then try to install vmware tools using script and hope installation will be completed.
====================================================================================
Scenario:7 How to sync the entire Directory Structure from Source to remote Destination Directory

Solution : # Using rsync command we can sync the entire directory structure from source to destination.

# rsync -a -f”+ */” -f”- *” / root@:/

Scenario:8 How to Change default Docker Root Directory on CentOS 7 / RHEL 7

Solution: Edit the file “/usr/lib/systemd/system/docker.service” and add the following line

docker.PNG

Specify the folder path after -g option , in my case i putting as ‘/storage/docker’

Reload daemon and restart docker service

docker.PNG

Verify docker root directory with ‘docker info’ command

docker

Kindly share your real time scenarios and issues with their solution at rajkumar123876@gmail.com

How to Install Jenkins on CentOS 7

How to Install Jenkins on CentOS 7

Jenkins is a popular open source CI (Continuous Integration) tool which is widely used for project development, deployment, and automation.

This article will guide you through the process of installing Jen

kins on a CentOS 7 server instance. In order to facilitate visitors’ access, Nginx will also be installed as the reverse proxy for Jenkins.

Prerequisites
Before proceeding, you must have:

Deployed a CentOS 7 server instance from scratch.
Logged into your machine as a non-root user with sudo privileges.
Step 1: Update your CentOS 7 system
One of the Linux system administrator’s best practices is keeping a system up to date. Install the latest stable packages, then reboot.

sudo yum install epel-release
sudo yum update
sudo reboot
When the reboot finishes, login with the same sudo user.

Step 2: Install Java
Before you can install Jenkins, you need to setup a Java virtual machine on your system. Here, let’s install the latest OpenJDK Runtime Environment 1.8.0 using YUM:

sudo yum install java-1.8.0-openjdk.x86_64
After the installation, you can confirm it by running the following command:

java -version
This command will tell you about the Java runtime environment that you have installed:

openjdk version “1.8.0_91”
OpenJDK Runtime Environment (build 1.8.0_91-b14)
OpenJDK 64-Bit Server VM (build 25.91-b14, mixed mode)
In order to help Java-based applications locate the Java virtual machine properly, you need to set two environment variables: “JAVA_HOME” and “JRE_HOME”.

sudo cp /etc/profile /etc/profile_backup
echo ‘export JAVA_HOME=/usr/lib/jvm/jre-1.8.0-openjdk’ | sudo tee -a /etc/profile
echo ‘export JRE_HOME=/usr/lib/jvm/jre’ | sudo tee -a /etc/profile
source /etc/profile
Finally, you can print them for review:

echo $JAVA_HOME
echo $JRE_HOME
Step 3: Install Jenkins
Use the official YUM repo to install the latest stable version of Jenkins, which is 1.651.2 at the time of writing:

cd ~
sudo wget -O /etc/yum.repos.d/jenkins.repo https://pkg.jenkins.io/redhat-stable/jenkins.repo
sudo rpm –import https://pkg.jenkins.io/redhat-stable/jenkins.io.key
yum install jenkins
Start the Jenkins service and set it to run at boot time:

sudo systemctl start jenkins.service
sudo systemctl enable jenkins.service
In order to allow visitors access to Jenkins, you need to allow inbound traffic on port 8080:

sudo firewall-cmd –zone=public –permanent –add-port=8080/tcp
sudo firewall-cmd –reload
Now, test Jenkins by visiting the following address from your web browser:

http://:8080
Step 4: Install Nginx (optional)
In order to facilitate visitors’ access to Jenkins, you can setup an Nginx reverse proxy for Jenkins, so visitors will no longer need to key in the port number 8080 when accessing your Jenkins application.

Install Nginx using YUM:

sudo yum install nginx
Modify the configuration of Nginx:

sudo vi /etc/nginx/nginx.conf
Find the two lines below:

location / {
}
Insert the six lines below into the { } segment:

proxy_pass http://127.0.0.1:8080;
proxy_redirect off;
proxy_set_header Host $host;
proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
proxy_set_header X-Forwarded-Proto $scheme;
The final result should be:

location / {
proxy_pass http://127.0.0.1:8080;
proxy_redirect off;
proxy_set_header Host $host;
proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
proxy_set_header X-Forwarded-Proto $scheme;
}
Save and quit:

:wq
Start and enable the Nginx service:

sudo systemctl start nginx.service
sudo systemctl enable nginx.service
Allow traffic on port 80:

sudo firewall-cmd –zone=public –permanent –add-service=http
sudo firewall-cmd –reload
Finally, visit the following address from your web browser to confirm your installation:

http://

Sytem going to emergency mode when restarting SSHD / any service and asking for root password

Hello Team,

Please find the RCA for the issue Server carc-vhybp05 went in to maintenance mode
Server name : carc-vhybp05
Cause : Maintenance mode

Cause for the issue dm-6 device
Logs seen After resolving issue. i have found these errors after troubleshooting, observed device dm-6 was the cause for the issue as per below logs.

Mar 14 00:22:26 carc-vhybp05 kernel: [ 205.650511] XFS (dm-6): Invalid superblock magic number
Mar 14 00:22:26 carc-vhybp05 kernel: XFS (dm-6): Invalid superblock magic number [ ============>>>> /log which is device dm- 6 cause for the server maintenance ]
Mar 14 00:22:49 carc-vhybp05 kernel: [ 228.321470] EXT4-fs (dm-6): recovery complete
Mar 14 00:22:49 carc-vhybp05 kernel: EXT4-fs (dm-6): recovery complete
Mar 14 00:22:49 carc-vhybp05 kernel: EXT4-fs (dm-6): mounted filesystem with ordered data mode. Opts: (null)
Mar 14 00:22:49 carc-vhybp05 kernel: [ 228.322736] EXT4-fs (dm-6): mounted filesystem with ordered data mode. Opts: (null)
Mar 14 00:25:52 carc-vhybp05 kernel: 411.195546] systemd-fstab-generator[14004]: Mount point is not a valid path, ignoring.
Mar 14 00:31:12 carc-vhybp05 kernel: Initializing cgroup subsys cpuset

I have uncommented the /log from /etc/fstab and rebooted the server to bring up, server came up after commenting /log in /etc/fstab

After commenting /log filesystem and once server came up seen below is the sequence of booting the devices up,
Here I can see dm-6 is not showing as we have commented in /etc/fstab .

Mar 14 00:31:15 carc-vhybp05 kernel: XFS (sda1): Mounting V4 Filesystem
Mar 14 00:31:16 carc-vhybp05 kernel: XFS (sda1): Ending clean mount
Mar 14 00:31:17 carc-vhybp05 kernel: XFS (dm-2): Mounting V4 Filesystem
Mar 14 00:31:17 carc-vhybp05 kernel: XFS (dm-3): Mounting V4 Filesystem
Mar 14 00:31:17 carc-vhybp05 kernel: XFS (dm-5): Mounting V4 Filesystem
Mar 14 00:31:17 carc-vhybp05 kernel: XFS (dm-4): Mounting V4 Filesystem
Mar 14 00:31:17 carc-vhybp05 kernel: XFS (dm-3): Ending clean mount
Mar 14 00:31:17 carc-vhybp05 kernel: XFS (dm-5): Ending clean mount
Mar 14 00:31:17 carc-vhybp05 kernel: XFS (dm-2): Ending clean mount
Mar 14 00:31:17 carc-vhybp05 kernel: XFS (dm-7): Mounting V5 Filesystem
Mar 14 00:31:17 carc-vhybp05 kernel: XFS (dm-7): Ending clean mount
Mar 14 00:31:18 carc-vhybp05 kernel: XFS (dm-4): Ending clean mount
Mar 14 00:31:18 carc-vhybp05 kernel: type=1305 audit(1521001878.305:3): audi

Mar 14 00:31:44 carc-vhybp05 kernel: [ 4.666920] Adding 2097148k swap on /dev/mapper/vg_root-lv_swap. Priority:-1 extents:1 across:2097148k FS
Mar 14 00:31:44 carc-vhybp05 kernel: [ 4.709909] XFS (sda1): Mounting V4 Filesystem
Mar 14 00:31:44 carc-vhybp05 kernel: [ 5.568137] XFS (sda1): Ending clean mount
Mar 14 00:31:44 carc-vhybp05 kernel: [ 6.396495] XFS (dm-2): Mounting V4 Filesystem
Mar 14 00:31:44 carc-vhybp05 kernel: [ 6.401301] XFS (dm-3): Mounting V4 Filesystem
Mar 14 00:31:44 carc-vhybp05 kernel: [ 6.403628] XFS (dm-5): Mounting V4 Filesystem
Mar 14 00:31:44 carc-vhybp05 kernel: [ 6.410001] XFS (dm-4): Mounting V4 Filesystem
Mar 14 00:31:44 carc-vhybp05 kernel: [ 6.452598] XFS (dm-3): Ending clean mount
Mar 14 00:31:44 carc-vhybp05 kernel: [ 6.454234] XFS (dm-5): Ending clean mount
Mar 14 00:31:44 carc-vhybp05 kernel: [ 6.466598] XFS (dm-2): Ending clean mount
Mar 14 00:31:44 carc-vhybp05 kernel: 6.488319] systemd-journald[521]: Received request to flush runtime journal from PID 1
Mar 14 00:31:44 carc-vhybp05 kernel: [ 6.601318] XFS (dm-7): Mounting V5 Filesystem
Mar 14 00:31:44 carc-vhybp05 kernel: [ 6.670950] XFS (dm-7): Ending clean mount
Mar 14 00:31:44 carc-vhybp05 kernel: [ 7.296935] XFS (dm-4): Ending clean mount
Mar 14 00:31:44 carc-vhybp05 kernel: [ 7.434090] type=1305 audit(1521001878.305:3): audit_pid=749 old=0 auid=4294967295 ses=4294967295 res=1
Mar 14 00:31:44 carc-vhybp05 kernel: [ 9.570701] NET: Registered protocol family 40
Mar 14 00:31:44 carc-vhybp05 kernel: [ 10.892682] vmxnet3 0000:0b:00.0 ens192: intr type 3, mo

After system came up, mounted /log filesystem manually and see the below logs, here /log mounted when mounted manually but it doesn’t mounted when system rebooted.
Here from the above first logs i have observed something wrong with filesystem.

Logs from manual mount
——————–

Mar 14 00:33:19 carc-vhybp05 kernel: [ 128.326128] EXT4-fs (dm-6): mounted filesystem with ordered data mode. Opts: (null)
Mar 14 00:33:19 carc-vhybp05 kernel: EXT4-fs (dm-6): mounted filesystem with ordered data mode. Opts: (null)
Mar 14 00:53:01 carc-vhybp05 kernel: [ 1310.579444] device ens192 entered promiscuous mode
Mar 14 00:53:01 carc-vhybp05 kernel: device ens192 entered promiscuous mode

Resolution
================

Please find /etc/fstab output here /log is mounted with xfs filesystem as someone mounted it with xfs file system when server build or at some time as this is RHEL 7.4,
But when filesystem created it took dependency as EXT4 ( please find output from ” blkid ” command below)

[root@carc-vhybp05 ~]# cat /etc/fstab
#
# /etc/fstab
# Created by anaconda on Fri Aug 26 20:17:14 2016
i#
# Accessible filesystems, by reference, are maintained under ‘/dev/disk’
# See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info
#
/dev/mapper/vg_root-lv_root / xfs defaults 0 0
UUID=969966a3-51f2-4517-b394-e67edf9682bd /boot xfs defaults 0 0
/dev/mapper/vg_root-lv_home /home xfs defaults 0 0
/dev/mapper/vg_root-lv_opt /opt xfs defaults 0 0
/dev/mapper/vg_root-lv_tmp /tmp xfs defaults 0 0
/dev/mapper/vg_root-lv_var /var xfs defaults 0 0
/dev/mapper/vg_root-lv_swap swap swap defaults 0 0
/dev/datavg/datalv /data xfs defaults 0 0
/dev/mapper/vg_root-log_root /log xfs defaults 0 0
128.11.138.119:/ProductionRoot /production_nas nfs nolock 0 0
128.11.138.120:/StagingRoot /staging_nas nfs nolock 0 0

Output of blkid
===================

[root@carc-vhybp05 ~]# blkid
/dev/mapper/vg_root-lv_var: UUID=”f73233fd-f583-4bc3-9873-7914b3fd5e7d” TYPE=”xfs”
/dev/sda2: UUID=”ZQOzKa-BWjw-9s36-XCqL-LmaC-me6O-8OLWfS” TYPE=”LVM2_member”
/dev/mapper/vg_root-lv_root: UUID=”d5d8fd0b-326b-407d-92d5-10cf184245f0″ TYPE=”xfs”
/dev/sda1: UUID=”969966a3-51f2-4517-b394-e67edf9682bd” TYPE=”xfs”
/dev/mapper/vg_root-lv_swap: UUID=”a64425a2-fca6-4a6e-966c-fd3d20c7aea2″ TYPE=”swap”
/dev/sdb: UUID=”QWLVik-qLcf-0iAr-T3Ns-y8vz-Un9Q-OQ0CaC” TYPE=”LVM2_member”
/dev/mapper/vg_root-lv_home: UUID=”fb2f6bbe-78f8-4a85-82a6-03580dd25d15″ TYPE=”xfs”
/dev/mapper/vg_root-lv_opt: UUID=”0016a463-0453-4cc3-929e-1dc8bfcfc2cc” TYPE=”xfs”
/dev/mapper/vg_root-lv_tmp: UUID=”a9cfdefb-d128-4cce-86b6-406d2a9f439c” TYPE=”xfs”
/dev/mapper/vg_root-log_root: UUID=”f6a2f847-ee99-4fbe-adf1-c0d87c385c3e” TYPE=”ext4″
/dev/mapper/datavg-datalv: UUID=”d304d1bd-2dd6-4ac4-8c50-6395de4787d5″ TYPE=”xfs”

Output of df -h
=======================
[root@carc-vhybp05 ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_root-lv_root 8.0G 5.1G 3.0G 64% /
devtmpfs 7.8G 0 7.8G 0% /dev
tmpfs 7.8G 12K 7.8G 1% /dev/shm
tmpfs 7.8G 8.8M 7.8G 1% /run
tmpfs 7.8G 0 7.8G 0% /sys/fs/cgroup
/dev/sda1 497M 216M 281M 44% /boot
/dev/mapper/vg_root-lv_home 30G 1.8G 29G 6% /home
/dev/mapper/vg_root-lv_tmp 10G 33M 10G 1% /tmp
/dev/mapper/vg_root-lv_var 8.0G 1022M 7.0G 13% /var
/dev/mapper/datavg-datalv 50G 334M 50G 1% /data
/dev/mapper/vg_root-lv_opt 8.0G 277M 7.8G 4% /opt
tmpfs 1.6G 0 1.6G 0% /run/user/1025
128.11.138.120:/StagingRoot 250G 232G 19G 93% /staging_nas
128.11.138.119:/ProductionRoot 650G 625G 26G 97% /production_nas
tmpfs 1.6G 0 1.6G 0% /run/user/0
/dev/mapper/vg_root-log_root 13G 2.2G 9.9G 18% /log

To install anything which have .rpm steps.

http://www.tecmint.com/linux-rpm-package-management-interview-questions/
http://www.tecmint.com/yum-package-management-cron-job-scheduling-monitoring-linux-logs/
===================================================================
Yum issue and error cds load balancer not connecting repo sudo non root user
https://access.redhat.com/support/cases/#/case/01943257
edit the file /etc/yum/pluginconf.d/rhui-lb.conf
change the enabled=1 to 0 and try yum list for sudo user using sudo yum list
enabled=1 <================ Alter this file so that this is a 0

[root@serverr pluginconf.d]# cat rhui-lb.conf_03_10_2017
[main]

enabled=1
cds_list_file=/etc/yum.repos.d/rhui-load-balancers
————————————————————
[root@server pluginconf.d]# cat /etc/yum/pluginconf.d/rhui-lb.conf
[main]

enabled=0
cds_list_file=/etc/yum.repos.d/rhui-load-balancers
——————————————————–
vim etc/yum.repos.d/rh-cloud.repo

[rhui-rhel-6-server-rhui-rpms]
name=Red Hat Enterprise Linux 6 Server from RHUI (RPMs)
mirrorlist=https://pyr-inf-rhcds02.apacvbk.cbu.csc.com/pulp/mirror//content/dist/rhel/rhui/server/6/$releasever/$basearch/os
enabled=1 <================ Alter this file so that this is a 0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
sslverify=1
sslcacert=/etc/pki/rhui/ca.crt
sslclientcert=/etc/pki/rhui/product/content.crt
sslclientkey=/etc/pki/rhui/key.pem

Repository ‘rhui-rhel-7-server-rhui-rh-common-rpms’: Error parsing config: Error parsing “gpgcheck = ‘i'”: invalid boolean value

##################################################################################

Error
———-
Loaded plugins: product-id, rhui-lb, search-disabled-repos, subscription-manager
Repository ‘rhui-rhel-7-server-rhui-rh-common-rpms’: Error parsing config: Error parsing “gpgcheck = ‘i'”: invalid boolean value
rhel-7-server-rpms | 3.5 kB 00:00:00
rhel-server-rhscl-7-rpms | 3.5 kB 00:00:00
https://cdc-inf-rhcds01.cdc-dc1-core.cscehub.com/pulp/repos///content/dist/rhel/rhui/server/7/7Server/x86_64/optional/os/repodata/repomd.xml: [Errno 14] HTTPS Error 401 – Unauthorized
Trying other mirror.
https://cdc-inf-rhcds02.cdc-dc1-core.cscehub.com/pulp/repos///content/dist/rhel/rhui/server/7/7Server/x86_64/optional/os/repodata/repomd.xml: [Errno 14] HTTPS Error 401 – Unauthorized
Trying other mirror.

=================================
Resolution below
—————————

1. subscription-manager list –consumed

2. go to cd /etc/yum.repos.d –> cat rh-cloud.repo

[root@carc-vjavas01 yum.repos.d]# cat rh-cloud.repo
[rhui-rhel-7-server-rhui-optional-rpms]
name=Red Hat Enterprise Linux 7 Server – Optional from RHUI (RPMs)
mirrorlist=https://cdc-inf-rhcds02.cdc-dc1-core.cscehub.com/pulp/mirror//content/dist/rhel/rhui/server/7/$releasever/$basearch/optional/os
enabled=0 <<=============================== altered this from 1 to 0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
sslverify=1
sslcacert=/etc/pki/rhui/ca.crt
sslclientcert=/etc/pki/rhui/product/content.crt
sslclientkey=/etc/pki/rhui/key.pem
skip_if_unavailable = 1
keepcache = 0

[rhui-rhel-7-server-rhui-rh-common-rpms]
name=Red Hat Enterprise Linux 7 Server – RH Common from RHUI (RPMs)
mirrorlist=https://cdc-inf-rhcds02.cdc-dc1-core.cscehub.com/pulp/mirror//content/dist/rhel/rhui/server/7/$releasever/$basearch/rh-common/os
enabled=0 <<=============================== altered this from 1 to 0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
sslverify=1
sslcacert=/etc/pki/rhui/ca.crt
sslclientcert=/etc/pki/rhui/product/content.crt
sslclientkey=/etc/pki/rhui/key.pem

[rhui-rhel-7-server-rhui-rpms]
name=Red Hat Enterprise Linux 7 Server from RHUI (RPMs)
mirrorlist=https://cdc-inf-rhcds02.cdc-dc1-core.cscehub.com/pulp/mirror//content/dist/rhel/rhui/server/7/$releasever/$basearch/os
enabled=0 <<=============================== altered this from 1 to 0
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release
sslverify=1
sslcacert=/etc/pki/rhui/ca.crt
sslclientcert=/etc/pki/rhui/product/content.crt
sslclientkey=/etc/pki/rhui/key.pem

[root@carc-vjavas01 yum.repos.d]#

3.[root@server pluginconf.d]# cat rhui-lb.conf
[main]

enabled=0 <<=============================== altered this from "1" to "0"
cds_list_file=/etc/yum.repos.d/rhui-load-balancers
[root@carc-vjavas01 pluginconf.d]#

4.[root@server ~]# cd /etc/yum/pluginconf.d/
[root@server pluginconf.d]#
[root@server pluginconf.d]# cat search-disabled-repos.conf
[main]
enabled=1

# With notify_only=1 this plugin does not modify yum's behaviour.
# Setting notify_only to 0 will enable yum to try to automatically resolve
# dependency errors by temporarily enabling disabled repos and searching
# for missing dependencies. If that helps resolve dependencies, yum will
# suggest to permanently enable the repositories that have helped find
# missing dependencies.
# IMPORTANT: running yum with –assumeyes (or assumeyes config option)
# will make yum automatically and without prompting the user temporarily
# enable all repositories, and if it helps resolve dependencies yum will
# permanently enable the repos that helped without prompting the user.
notify_only=0 <<=============================== altered this from " 1" to" 0 "

# Repositories matching the patterns listed in ignored_repos will not be enabled by the plugin
ignored_repos=*debug-rpms *source-rpms *beta-rpms
[root@carc-vjavas01 pluginconf.d]#

Once done with above steps
5.yum update -y
6.yum update -y –skip-broken

Files edited from the above
=============================
cd /etc/yum.repos.d/rh-cloud.repo
cd /etc/yum/pluginconf.d/rhui-lb.conf
cd /etc/yum/pluginconf.d/search-disabled-repos.conf

[Errno 14] PYCURL ERROR Trying other mirror

####################################################################################
Error yum repo
==================
https://pyr-inf-rhcds02.apacvbk.cbu.csc.com/pulp/repos///content/dist/rhel/rhui/server/6/6Server/x86_64/os/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 – “The requested URL returned error: 401 Authorization Required”
Trying other mirror.
https://pyr-inf-rhcds01.apacvbk.cbu.csc.com/pulp/repos///content/dist/rhel/rhui/server/6/6Server/x86_64/os/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 – “The requested URL returned error: 401 Authorization Required”
Trying other mirror.
https://pyr-inf-rhcds02.apacvbk.cbu.csc.com/pulp/repos///content/dist/rhel/rhui/server/6/6Server/x86_64/os/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 – “The requested URL returned error: 401 Authorization Required”

> Host was not able to access the yum repolist.
> Was generating the error [Errno 14] PYCURL ERROR 22 – “The requested URL returned error: 401 Authorization Required”
> After troubleshooting found incorrect rpm was installed related to certs.
> The correct package was pyr-inf-rhel6-2.0-1.noarch.

Resolved by below steps
=========================

Unistalled below packages
=============================
rpm -e redhat-config-client-2.0-1.noarch
rpm -e pyr-inf-rhui-rhel6_x86_64-2.0-1.noarch

Installed new package
===========================
rpm -ivh pyr-inf-rhel6-2.0-1.noarch.rpm