2014年2月27日星期四

c3750 not manageable

I started experiencing a weird problem with one of my WS-C3750X-12S-S   today. It seems that connectivity to the managment IP has become sporadic...
I can ping it and get maybe 2-3 responses, then a couple minutes of no responses. However, the switch is still passing traffic normally, users connected to it are not experiencing any symptoms.

Switch is running IOS 12.2(44)SE2 and is connected via 802.1q trunk to 2801 with only 2 VLANs. There's really not a lot of traffic going through this switch. I can't connect to the switch from the directly connected router or elsewhere on my network.

I sat with my finger on the "Get Tree" button in my SNMP MIB Browser, to try gathering some data when it became available to begin narrowing down where the issue could be. Here's what I've found / checked so far:
CPU (via CISCO-PROCESS-MIB):
around 5-10% for all 3 values (1 sec, 5 sec etc)
Memory:
There is pleanty of memory free, nothing out of the ordinary
Syslog:
Log messages are not getting to Syslog server, but the few I've pulled via SNMP look normal. Just interfaces state changes mostly, which is normal at this location.
Interfaces(via MIB-2 interfaces table):
no input or output errors on uplink port or any other ports for that matter, looks very clean.
ARP
Verified ARP on the 2801 is staying the same for the IP of the switch.
Other Observations:
I was able to connect for a few seconds and noticed NTP wasn't syncing.
When the switch is replying to Pings, response times are high (300 - 1900[?!]ms). I verified those high ping response times were not due to latency on the location's WAN connection (T1 is at low utilization)
Issue started today at some point. No changes were made to the switch or environment at that location.

I'm not able to reboot the device at the moment, I hope to do that this weekend, but I was curious if anyone has seen anything similar and had a fix other than rebooting. I'm not even sure if rebooting will help. Its odd that I can't manage the switch, but it is still passing voice and data traffic like it was yesterday.

 We saw something kind of similar in a 6 switch stack .  But our problem appeared to be the  stackmaster had a slow memory leak and occassionally we would not be able to manage the stack for awhile then it would come back  . Switch and port  utilizations once we got in were low across all 6 switches .  I'm speculating in our case because this box is used  as a jump box  into the rest of the net and maybe  it was not releasing memory resources once we got out . We were also getting low free memory warnings from a snmp monitoring tool. We reloaded the entire 6 switch stack and so far we have not seen a WS-C3750V2-48PS-S    reoccurence, think we are at 12.2.35SE something .

2014年2月19日星期三

c3750 not manageable

I started experiencing a weird problem with one of my WS-C3750X-48T-L   today. It seems that connectivity to the managment IP has become sporadic...

I can ping it and get maybe 2-3 responses, then a couple minutes of no responses. However, the switch is still passing traffic normally, users connected to it are not experiencing any symptoms.

Switch is running IOS 12.2(44)SE2 and is connected via 802.1q trunk to 2801 with only 2 VLANs. There's really not a lot of traffic going through this switch. I can't connect to the switch from the directly connected router or elsewhere on my network.

I sat with my finger on the "Get Tree" button in my SNMP MIB Browser, to try gathering some data when it became available to begin narrowing down where the issue could be. Here's what I've found / checked so far:

CPU (via CISCO-PROCESS-MIB):

around 5-10% for all 3 values (1 sec, 5 sec etc)

Memory:

There is pleanty of memory free, nothing out of the ordinary

Syslog:

Log messages are not getting to Syslog server, but the few I've pulled via SNMP look normal. Just interfaces state changes mostly, which is normal at this location.

Interfaces(via MIB-2 interfaces table):

no input or output errors on uplink port or any other ports for that matter, looks very clean.

ARP

Verified ARP on the 2801 is staying the same for the IP of the switch.

Other Observations:

I was able to connect for a few seconds and noticed NTP wasn't syncing.

When the switch is replying to Pings, response times are high (300 - 1900[?!]ms). I verified those high ping response times were not due to latency on the location's WAN connection (T1 is at low utilization)

Issue started today at some point. No changes were made to the switch or environment at that location.

I'm not able to reboot the device at the moment, I hope to do that this weekend, but I was curious if anyone has seen anything similar and had a fix other than rebooting. I'm not even sure if rebooting will help. Its odd that I can't manage the switch, but it is still passing voice and data traffic like it was yesterday. Thanks

  We saw something kind of similar in a 6 switch stack .  But our problem appeared to be the  stackmaster had a slow memory leak and occassionally we would not be able to manage the stack for awhile then it would come back  . Switch and port  utilizations once we got in were low across all 6 switches .  I'm speculating in our case because this box is used  as a jump box  into the rest of the net and maybe  it was not releasing memory resources once we got out . We were also getting low free memory warnings from a snmp monitoring tool. We reloaded the entire 6 switch stack and so far we have not seen a reoccurence, think we are at WS-C3750X-24T-S   something .


 

2014年2月17日星期一

Catalyst 2900 XL CMS does not load

I recently acquired a Cisco 2951    that was taken out of service and I am trying to use it at home. I have it setup as a stand alone switch, and I can access the switch from another PC by my web browser and the IP of the switch. I found out that the switch has IOS release 12.0(5)WC3. What I am trying to do is access the switch by the CMS from the switch main page and it starts to load then the Java application fails and all I get is a blank screen. I would like update the software to 12.0.(5)WC16 but I don't know how to upgrade it using the Telnet? Is it possible to use Win XP, IE7 & the latest version of Java to access the CMS page? I read in some documentation that IE5 or 5.5 and Java Plug-in 1.3.1 is supported...

Update:

I have been doing some messing around and I got it to work. I updated the switch software from 12.0(5)WC3b to 12.0(5)WC16 using a TFTP server that was free from SolarWinds. After I got that updated I tried Win2000, IE 5.0, Java plug-in 1.3.0 & 1.3.1. I did not get this configuration to work. I then tried WinXP with IE7 & the Java plug-in 1.4.0 and it worked great! So I answered my own questions...


This first post of such types in the whole of netpro !!! ques & ans on the same post :) pls mark the Cisco 2901-SEC   post as solved which can help others..

2014年2月12日星期三

Issue with Cisco 3560-C Switch

 I purchased a pair of airFiber antennas to replace my current site link between buildings that was using Cisco 1300 wireless bridges. The main reason was because I was only getting about 12 Mbps throughput on a 500 meter link.

Anyway, after I got everything mounted, alligned, and configured they showed that the link was "operational" and they could communicate with each other. The only problem was that no network traffic was crossing the link. So I began to troubleshoot. One end is connected to a Cisco Catalyst 2960 switch while the other is connected to a Cisco WS-C3560X-24P-S  (layer 3 switch). The first switch and both airFiber antennas are on the same network. The 3560-C switch handles routing between the different networks for this site. I set everything up exactly how I had it with the Cisco bridge.

Now I noticed that when I plugged the airFiber antenna (happens to be the slave) into the 3560-C switch, the switch lost all routing capability. I made sure there were no loops when trying this and that the ports for the antennas on both ends were configured correctly (trunking, etc.), it still killed routing. I had already upgrade each antenna's firmware to v1.5 so I tried v1.1.2. It made no difference. No matter what I did, the moment I plugged the antenna into the 3560-C switch, it killed routing. And what I mean by "killed routing" is that the switch couldn't even communicate with another directly attached switch or any other network.


When you plug cat3560 into the AF, can you copy sh logging output? Maybe sh spa , sh interfaces, sh proc cpu history and so on and post it here?  It's nonsense, AF is only transparent bridge WS-C3560V2-24PS-S  , nothing else. I don't think it can kill routing :manhappy:

2014年2月10日星期一

memory utilization graph with cisco 3560

we are currently testing OpManager before purchasing the Professional Version.

We are testing OpManager with a Cisco catalyst 2950 series 12G and a Cisco catalyst WS-C3560X-48T-L  series 24 PoE.

We tried the discovery function, and OpManager found the 2950 as a 2950 and the 3560 as a desktop.

The specific OID for the 3560 wasnt in the database, so we added it with admin\device type\add new device\ and the OID .1.3.6.1.4.1.9.1.563

We deleted the 3560 and rediscovered it. Opmanager found it as a 3560 but we still have problems:

1. The resource monitor Memory Utilization which appeared by default with the 2950, doesnt appear with the 3560 so the memory utilization graph doesnt seem to appear too.

We created a custom monitor for the memory utilization with the following OID:

(1.3.6.1.4.1.9.9.48.1.1.1.5.1*100)/(.1.3.6.1.4.1.9.9.48.1.1.1.5.1+.1.3.6.1.4.1.9.9.48.1.1.1.6.1)

This requests works but we cant associate it with the memory graph.

You can remove the Memory Utilization for that specific device under Resource Monitor. After the removing the monitor, then follow the steps given below

Please add this default graph under cisco monitors in OpManager_graphinfo.xml which is under /opmanager/conf

<DEFAULTGRAPH Name="SwitchMemoryUtilization">

<YAXISTEXT>Percentage</YAXISTEXT>

<DISPLAYNAME>Switch Memory Utilization</DISPLAYNAME>

<name>SwitchMemoryUtilization</name>

<Vendor>CISCO</Vendor>

<Monitor>Resource</Monitor>

<Description>Monitors the Memory Utilization</Description>

<oid>(.1.3.6.1.4.1.9.9.48.1.1.1.5.1*100)/(.1.3.6.1.4.1.9.9.48.1.1.1.5.1+.1.3.6.1.4.1.9.9.48.1.1.1.6.1)</oid>

<type>Interface</type>

<interval>900</interval>

<THRESHOLDENABLED>false</THRESHOLDENABLED>

</DEFAULTGRAPH>

Then Open Opmanager_snapshotinfo.xml under /opmanager/conf and find this entry

<CHART>

<Name>MemoryUtilization</Name>

<Title>Memory Utilization</Title>

<Type>AREA</Type>

<Height>250</Height>

<Width>525</Width>

<yaxisLabel>Memory Utilization %</yaxisLabel>

<CHART-INFO>

<PolledDataName>SwitchMemoryUtilization</PolledDataName>

<Color>blue</Color>

<YAXISTEXT>Memory Utilization %</YAXISTEXT>

<DISPLAYNAME>Memory Utilization %</DISPLAYNAME>

<name>MemoryUtilization</name>

<Vendor>OtherCISCO</Vendor>

<oid>(.1.3.6.1.4.1.9.9.48.1.1.1.5.1*100)/(.1.3.6.1.4.1.9.9.48.1.1.1.5.1+.1.3.6.1.4.1.9.9.48.1.1.1.6.1)</oid>

<type>node</type>

<interval>900</interval>

<THRESHOLDENABLED>false</THRESHOLDENABLED>

</CHART-INFO>

</CATEGORY>

</CHART>

Save the file. Restart OpManager. Then try to add the WS-C3560X-48T-S    Switch Memory utilization which is under Cisco Monitors. Now you will have an option for Switch Memory utilization.

2014年2月9日星期日

Calculate traffic amount on interface

I have not deployed any monitoring software yet; however, Cacti is in the works. But is it possible to change ‘five minute input rate / five minute output rate’ time interval from 5 min to secs and get an accurate account of traffic going over a FastEthernet interface? Would I choke the hardware (WS-C3750X-24T-L  ) if I can change this attribute? Would this be a good method to see the load/traffic values in real time? 

ACKGROUD:

The server team has deployed a new SQL server, and the DB devs are complaining that it is slow. I am suspecting that more traffic is going over the interfaces then what the ‘server team’ and ‘db devs’ indicated because they know I would raise a stink. I do not have access to the database server, nor the other end, yet I have access to network gear between the points.

Since I have never faced this type of issue, or problem – I need some direction and/or suggestions on how to troubleshoot this type of issue.

Issue the command load interval 30  on the interface and it will start displaying the input/output rate for 30 secs.

This won't impact the WS-C3750X-24T-S    efficiency of the switch..

For further troubleshooting of the issue check for any output drops/ input errors/crc in the show interface fax/y output.