07:30 - UP!� Man, I woke up early today.� Got the cats fed and coffee going.� My cold is pretty much gone but I'm still a little woogy from all the nyquil.� R.I.P. George Carlin!
- Saturday I got out for a little while & went down to Chandler Mall.� I got a salad for lunch at Paradise and sat at a book store reading for a while.� Saw Chez and Kellie on Sunday to drop something off.� Chez said that Ice-Queen was having her quarterly meeting this morning in Jasper, but I don't have it on my calendar so feck it.
- Email from SS @ EMC regarding TZ format on petrel & shearwater.� He says: "it seems that the short date format has been set on petrel and shearwater to be different than mm/dd/yyyy. On Crow and towhee it is set correctly"
This doesn't make any sense to me.� The servers are clones of one another so all of their TZ info is identical.
Checking locale (locale -a, locale -k LC_TIME), shows identical settings.
-- Requested clarification from SS.
9:15 - Guy from Mojo Systems reseller.� Wants to purchase our decomm hardware when we decide to sell.
- Contractor Adam S. wants "cron assistance" for server magnum.� This server doesn't show up on my list of systems (though I can't locate the SvrAss sheet offhand), since I know them all fairly intimately.� I can't ssh into it.� If this IP is valid for us, it'll be on CORE but I don't see it anywhere.� Will keep trying to locate it.� Asked Adam to call me.
9:45 - After much dilligent searching I located the svrass sheet and found magnum.� The IP in the sheet isn't what nslookup is reporting.� Something is out of whack.� Will wait for Adam to call.
9:55 - IM from Matt T.� - Code Migration from dev to QA this morning from 11-1 with SS from EMC.� Will clear up the TZ issue with him then.� Ahh-Nold is out of this one.� His mom died this weekend.
10:10 - Call from Adam S.� Seems he sent his question about cron to the generic unix-admin email account.� The server he's looking for is in Ohio, not Arizona.� Bounced him back to his own group.
10:45 - Grabbed tuna & crackers for lunch with tomato soup
10:50 - Slick reminded me of the work on vidalia for Hopalong.� Sent hoppy an IM asking him to open a ticket for me on vidalia.� Its been so long since I was asked about that, I forgot what they need.� I think they just need the machine spun out and stood up, but for some reason I seem to recall them needing additional disk.�
11:00 - Talked with SS on the code migration.� He started it up & said it'll take a couple of hours.� We talked about the TZ issue.� He said Cliff reported the problem to him, and he didn't verify or check it, just forwarded it off to me.
- I explain to SS that the locale formats on the two machines are identical.� He says Cliff told him they aren't.� He goes to verify.
- SS says that BOTH machines are showing the date as Jun 23, 2008, but they need to report 06/23/2008.
1:00 -- Fixed 113 for Brett.� Dunno wtf grandpa simpson did to his account but I had to delete it and re-add it again.� hooked him up with sudoers.� He says "all LM Portal servers" need to have this done, but I'm not entirely sure what that means.� Added the portal admin accts to sudoers for 113, 146, and 147.� Asked him for a list of IPs he needs the work done on just in case these aren't all.� (I'm fairly sure they aren't)
1:06 - Trevis is going to drop something off.� Told him I'd be here all day.
1:10 - Looking into problem pointed out by the Appliance guy on the Pathways servers.
1:15 - Brett sent a whole list of IPs.� 83, 112, 135, 138, 153, 154, 166, 169, 174, 207, 208.� Do these after fixing the pathways problem.
1:40 - the Pathways mounts were mounting as root.� I edited the fstab and put a mount option in: uid=4502 and remounted.� All files under the /pff mount now show with apache owner, create & delete of files doesn't give error.�
4:00 - The goddamn PFF code migration failed at 3:30 and SS had to restart the 2nd part of it.� It'll be another 2 hours before it finishes.� Let Matt T. know.�
10:00 - There are two things I need to say right up front.�
1. I caught a cold yesterday and I'm miserable today.
2. When Becky asked me about the "cannot resolve DN" yesterday, the _first_ thing I asked was "did anyone check the LDAP account?" and she told me they didn't use LDAP.� I asked "Are you _sure_?� I think DN is short for Distinguised Name, that's LDAP.� This is a WAS server.� I'm pretty sure this means Distinguished Name and not Domain Name."
-- It was an LDAP issue.� One thing that really tweaks me is spinning cycles on bad information.� People who make me run around in circles because they give me bad info should have to do my laundry or something.� They should be flogged with wet noodles and have to swim 3 laps in earthworm soup.� That is all.�
-- Chez and I had a good time at the Mercury game last night.� She said she'll be my wingman when we go out.� lol.� For some reason that really cracks me up.� I can tell that she's a good hearted person.� I think she's got a restless soul, I really hope Kellie turns out to be good for her.
-- The box seats were really neat, but we snuck down to the floor and sat in about the 17th row to watch the second half.� I'm not much of a sports fan at all, but I'll have to admit it was fun to watch and just be around lots of enthusiastic people.� The game was good, clean, family entertainment.� Even if the prices were unreal.
--
hah!� Slept late today too.� Didn't get out of the shower till a little after 9.
09:15 - dialed into the 9am OPS/ENG bridge.� Missed all the SAN stuff, but Mr. T said I already knew it and they just proceeded.� One Q about when PFF is going live, but I don't know the actual date.� PROD build starts July 1, that's all I know for sure.� I don't have the firm GO LIVE date.� (Fuck, it was suppsed to be March 15.)
9:50 - Pasted in yesterday's entry & Mr. T said we'll meet at 10:20 today for the weekly staph meating.� No problem.
10 - Need to figure out what I'm working on today.� My brain is scattered to the corners of the Earth.� Email exchange with "Windy Day Girl", we talked about having lunch sometime next week up in Skittsdale.� I go almost 3 years without meeting any intelligent, attractive lesbians, and suddenly they're falling out of the sky.� :)� Lucky me.
10:30 - Staph meating.� I can't fucking get logged into NewYork.� Every few weeks it gets fucko and won't let me in.� I even went through the Madison servers and still no-go.� Slick will look at that for me after the meating.
-- Becky will be out a few weeks starting Monday.� I know she's having a hysterectomy, but she didn't tell anyone else.� I just heard her allude to "traveling" so clearly she doesn't want to share with the boys.� I won't say a word.� (I'm aware of the fact that I just did, but you don't know her so its okay.� Privacy through Obscurity.)
-- More talk about the SAN upgrade/changes for this weekend.
-- Mid-Year reviews are coming up.
-- Lunch break.� Ran to Fry's to get cat food and a few other items.� Picked up a sammich at Subway.� Back home and working.
1:00 - Chez scored tix to a women's basketball game tonight.� I'm going to pick her up at her place and drive us both.� Only one parking pass + Chez will want a beer or two.� I'll be designated driver.
1:10 - Adjusted ticket queue.� Opened ticket for Pine disk add.� Checked status of disk add for minotaur cluster.� No forward motion.� She's probably busy working on the san switch stuff for this weekend.
1:40 - After much fucking around with our ticketing system I finally programmed 4 very useful auto-queries for myself.� One is "All tickets I've assigned to others", one is "My Active Assignments", one is "My Overdue Assignments", and the other is "All Engineering Unassigned Tickets".� I set them up to auto-start every time my system starts up, that way I can see at a glance what I've got in the works for the day.
1:45 - Started working on Pooh Bear's Oracle issues on the RHEL x_64 Delphi LM system.� Lots of packages to check/install.
�4:20 - working on weird issue for Becky.� she says:
"it's throwing this error:� [De scription: Resolving short name to full DN failed - no entry found. ]"
-- Daddy Google doesn't say much about it.� nslookup finds the hosts ok.� Dorked with the nsswitch file to make sure its looking in the right places for the names.� Checked with both short name & FQDN.� She put entries in the host table to see if it really isn't looking it up, all no good.
-- started watching network traffic as she was working with the developers, filtered out her IP, mine, and a few others to get a better handle on what's flowing where.� Flipped the nameservers around and even had it start querying the PROD NS instead of the LM NS, but no go.
-- Becky asked the developers to use the old code.� They said it works, old code, old servers.� Try the old code with the new servers, and it doesn't work.� Asked her to have them try the "old servers" with the "new code" to see if that works.� It might tell me if the problem is a configuration issue with the new servers, or if the new servers aren't configured properly in DNS.
-- 5:10 pm and I need to get my shit together to meet Chez.� Sent email to Slick and Grandpa Simpson to check the DNS on fosters in the AM.
I'm OUT!
9am - woke up late.� fuuuuuck.� I have to be at the office at 11 for the 11-1pm (lunch) meeting.�
9:20 - Chez wants to have lunch this week.� Told her I'm in the office today so maybe we can have coffee after I'm finished with my meetings.� She's up for it.� Kinda' strange, I'm not sure exactly why she wants to go out.� I think she's being flirty, which is totally cool with me.�
11:10 a little late to the meeting, nobody is here anyway.� Mr. T and Slick are sitting there staring at the phone.� Apparently Thug and Cartman didn't see the need to come in for this presentation and Margie got sidetracked with some fucko SAN problem.� Grandpa Simpson isn't in the office, he's working with Margie on something.
11:20 Gpa Simpson comes back, let's get started.
0000
�
-- We finished the meeting after going over the same data 3 times for people with ADHD.� Two people didn't bring their homework.� Asshats. �
-- Long protracted discussion about some SAN remediation project that's rolling this weekend.� Nobody consulted Engineering.� Nice.� OPS guys (Margie, Mac, Stewie, etc) are upgrading firmware on one of our SAN Switches and will need to shut down all the 2.5 boxes.� Which means ENG has to shut them down because OPS isn't allowed to touch them.
-- Requested Friday off.� lol.� Fuck 'em, I'm not staying all weekend for that and Tom and I were talking about going to San Diego anyway.
-- Got a cup of coffee with Chez.� We went to the coffee shop I worked at last summer (so I could learn how to make good coffee), and I found out that the owner sold it.� I was just thinking about buying the place a few days ago.� Very strange.� They've added a few little things and changed the atmosphere a little.� I hope it does well.
-- Chez is adorable.� just _adorable_� We had a nice time chatting and then went back to the office.� She gave me her number.� woot.� :)
-- Stood around and fucked off the rest of the afternoon.� Which wasn't really that long when I think about it.� It was aftter 1:30 before we got back from lunch, nearly 2pm before Chez and I went for coffee, and probably 2:25 before we got back to the office.�
-- Long "hallway" conversations with Slick, Mr. T, Watts, and others about work happening this weekend, bills from COX for my home connection that weren't getting sent to NW for payment, and just about everything else you can imagine.
-- Told Slick that I was going to go out for coffee with Chez.� He caught the funny.� lol.
-- Chez asked me to go out after work, actually asked me to split at 4 and go to a sports bar close to her place.� We went and had a drink.� She had 3 beers, I had a long-island-iced-tea.� nummy stuff.� She's a real sweety.� We're going to hang out more frequently and perhaps go to basketball games & maybe catch a beer now & then.� yay.
-- Ended up working a little late last night because I fucked off all day.� Got home around 7:30.� Bed by 1am.� yay.
8:15 - Ass crack of dawn.� Happy Monday.� Matt T. IM about PFF prod stand up.� Told him I've moved anhinga and blackbird over to sparta.� I need time to do the app installs in Prod.� I need time to adjust the disk mount (made a note about this a few days ago) from /opt to /apps.� No biggie.� Getting the documentum app installed will be a little tricker since I've only done it twice.� I do have notes though, should make it a little easier.� Will need assistance from Pooh Bear to make sure I can talk with the database on minotaur.
8:30 Becky called. - genseed portal gold.� add portal admin accts to gold image?� it'll make deployments easier in the long run.� Force them to use sudo or add them to was group?� It's a pain to sudo, but if they start it as the WAS processes as regular users things get fucko.� Agree to make them sudo.
9:10 - Jerry finally returned my calls regarding BTI.� She reiterated that the doc I sent on Friday seemed to be fine.� She asked Ashy if he needed anything else, to let her know.� She'll pass whatever she gets on to me and I can respond accordingly, but isn't expecting anything.
-- Skipper probably won't be hired on full time.� Looks like they picked up a St. Bernard instead.� Wonder how long Skipper will be with us now?� Don't know.� He scheduled a meeting for the 23rd on Asset Management installation.
-- Slick wants me onsite Tues for our ESX meeting.� I guess I can do that.� I asked if I could show up around 10, he says meating is 11-1, over lunch, so as long as I'm in for food and meeting, that's all good.� I figure I'll leave home around 9ish and get to Skittsdale around 9:45-10amish.�
9:15 Mac is out for the day.� He's been fucking around with the prdvrt systems all weekend.� He says : "volumes are still copying but I can copy only one at a time.� Something in this system sends aborts to the mirroring process.� Please let me know if anyone has thoughts about what.� The VxVM mirroring technique for copying data has been stable on earlier versions of Solaris, ealier and less power full systems, switches and arrays."� It's Solaris 7 Mac.� What do you expect besides fucko behavior?
9:30� - Mr. T.� added a 6gb disk at SCSI 2 on delphi (LM .2).� Could you destroy the existing /u01 (2gb slice of SCSI1) and create a new one using the 6gb disk?
Sure.� But I have to save this and reboot my laptop first.� fucko monitor situation.� Check with Oliver on ticket for LT exchange!
10:09 Rebooted laptop.� Right monitor is still clipping and tripping.� Not as bad as it was though.� I really need to check on the status of that replacement ticket.
logged into delphi and umounted /u01.� fdisk on /dev/sdc, lay down a new primary partition, write the table and partprobe it.� mkfs.ext3 then edit fstab to auto mount on boot.� mounting it up to /u01, no problem.� Send Pooh & Mr. T. note to let them know its done.
--� Russ says VPN will be down from 1-6AM on the 28th.� No biggie.� Saturday Morning.
�-- Tom wants to go to San Diego this weekend.� Remember to pack up cameras and find scuba shorty to swim in.� Fucking UVA/B allergy.� Also need to remember to go to Fry's and pick up some drinks etc.
-- Janice S hired on as FTE.� SA position reporting to Kathy J.
-- My fucking toes are fucking freezing.� Where are my socks?!� I also need to remember to bail early today (3:30ish) to get to appointment with Sofya by 4.� Let Mr. T. know.� Charge Blackberry.
-- Went outside for a few minutes.� Been inside most of the weekend.� it's 100 degrees outside and the heat feels great.� I think I was chilled to the bone.
10:22 - Stewie Griffin needs to run emcgrabs against SAN attached servers.� His list looks to be comprehensive.� He's got all the portal Sun DB boxes on here.� I hope he's doing them after hours.� Sent OK to proceed.
� -- He also wants to research Mac's issue from the weekend.� Sounds like a good idea but I'll let him work that out with Mac & Curious.
-- I need to get some food, it's almost 11.� Today I have to work on getting the tickets opened for the SAN add to pine and get to the bottom of their NAS-Head.� Why the hell do they want a nas head?� I still haven't figured that out.
�11:30 Becky - outbound email working on 183?� Probably not.
Get into genseed 183, sendmail not running, can't telnet to 25.� Check packages, sendmail & sendmail-cf are installed, just not configured.� Copy mc from pan and edit to alter mailer signature.� m4 sendmail.mc > sendmail.cf, m4 sendmail.mc > submit.cf.� restart sendmail and chkconfig on while I'm at it.� Telnet localhost 25 to test mail manually, dies on domain.� Have to edit /etc/mail/access to add the hosts.� again.� didn't I just do this 2 days ago?� lol.
telnet localhost 25
HELO
MAIL FROM:
RCPT TO: becky's address
RCPT TO: my address (copied)
DATA
note
.
quit
mailq
All good.� Let Becky know its sone.� She's going to check image back into library and it's good for future copies.
12:34 - email from Pooh Bear.� Need to upgrade bash on delphi to 2.05?� Thinks we have v2.04 installed.� Apparently having issues running the Oracle installer?� Pooh says:
cause: GNU bash version 2.04 fails to recognize the runInstaller as a executable
Uh.� I don't think so Tim.
[root@delphi ~]# bash -version GNU bash, version 3.00.15(1)-release (x86_64-redhat-linux-gnu) Copyright (C) 2004 Free Software Foundation, Inc.
Sending reply with this.� Whatever his problem is, he's going to have to take it up with Oracle.� We're running a compatible version of bash.
-- Jebus.� I'm half asleep.� I want to go take a hot shower to try to wake up but I know the second I get up from my desk, something will go apeshit.� I got a BTI meeting at 1:30, need to call santanna for that.� I can probably skip it, but Ashy will be there and he'll probably have something to say about the data I sent out last week.� I should attend.� Meetg runs till 2:30.� Sneaking in a quick shower so I can wake up.
1:07 -- HOT shower break!� 1:25 - that was awesome.�
1:30 -Called Santanna - no answer from Jerry.� Guess they don't need me on this call.� woot.
1:50 - Call from Jerry.� We may bag it, almost nobody showed up.� She offered to call Mr. T. and straighten out the issues with Ashy, but I asked her to just let it ride.� (Ashy was pissed at me over my response to his questions regarding CPUs on the ESX boxes.)
3:15 heading out to see Sofya.� Stewie Griffin says our named.log on our primary nameserver is eating up about 50% of /var.� I set up logrotate.conf to rotate that every 100M and to only keep 200M total.� Asked Gpa. Simpson to verify and asked Stewie to make those changes on all the NS machines as he sees fit.
Des Moines flooded & Tim Russert died.� Weird start.
8:20 Jess wants diagrams/graphs of the main resources of the linux systems that I collected during the IWS perf test.� I didn't do them, I just watched in real-time.� Didn't see any issues, so I didn't graph.� Guess I can do that sometime next week?� Who the hell has time to graph data that's going to be flat?
8:30 - Jerry wants the BTI info.
- Talked to Ratface about the BTi stuff I need to email to Ashy.� Talked with Mr. T. about it a little and agreed we're going to house it with pff.� at least the prod part.� I don't know what the deal is exactly so I just took the configs for the pff boxes and sent them to ashy.� Mr. T. said something about the prod sharing on sparta but the dev and qa not being on carson and wabasha.� buying new hardware for them?� That makes no sense.� I don't need new hardware.� Even if they aren't in core network there's plenty of excess capacity elsewhere.
- Left a couple of messages for Jerry regarding this BTI stuff.� No call back.� Ended up just going with what I got from Ratface & Mr. T.�
-- Sent this off around 3:30, she wanted it by 2, but no such luck. :(� She seemed to think it was excellent though so?� ok!
Mr. T. is out for the rest of the day.� Might be w@h early next week.
�9-- sper-dooge says to call K. rogers at NW if we need anything asafp and can't get a response from anone else.
-- Talked with Slick about the meeting we had scheduled for today.� Margie and Hooper had to bail.� Nobody else was interested.� Fuck it, he's going to reschedule.� This will give me more time to mess with the IWS LM stuff that's fucko. and other things like moving anhinga and blackbird over to sparta etc.
11ish - 1ish Some vague fumble-fucking around with Drew about something that won't run properly on the thyme LM servers.� Can't get access to page on specific port using localhost 127.0.0.1, I asked "did you just try the word 'localhost' with the port?", he tries it and it works.� I abandon my search for the proper port in /etc/system or by doing tcpdump.� He swears it was working but my tcpdump said it wasn't.� I dunno.� Fuck it.� He's happy, I'm happy.� Stop fucking calling me with silly shit!
12:45 Ramen Noodles from NW hooks me up with some other folk.
3ish - Got the stuff for Jerry together and sent off, everybody is happy so far.
Calling it a day.� happy friday.
8:30 - Sad Mark asks me if I got the questions answered that I had regarding minotaur work for Pooh.� My questions were related to how he wanted this SAN set.� Minotaur is something like an active/active cluster.� dsup on one wsmd on the other.� they want a nas head for this?� wtf?� these are Sun boxes.�
I thought I had the questions answered but then someone threw me off yesterday.� I asked the question about the nas head, but somehow got thrown off on the name.
Someone said in IM that we needed something done on "aster and not pine", and I thought they were talking about the SAN.� They weren't, it was related to the IWS testing going on at the time.� Got confused while multitasking.
It wasn't Forbes I talked to, I dont' know why Mr. T. asked him.
San needs to go on Pine.� The IWS testing was on Aster.� The ticket I opened for the SAN had aster in it.� Cancel that ticket and open a new set.
Need ticket for minotaur san add.� those will be cut up according to Pooh's needs.� No problem.� Yay Veritas.� Pine needs disk too.� Need to open a new ticket for that.� Haven't done it yet.
Then I need to figure out what the fuck he means by "a nas head" to follow the active node of the cluster.� That doesn't make any sense to me.� Why wouldn't I just add a shared san mount point to both servers where they could store data?� Why would they want a "nas head" ?
Tom says use NetApp filer.� But we dont' use any netapp and the budget is flat.� Make due with Clarion.
9am: fix Drews email into LM
PFF:
9:30ish - I shut down Petrel and pushed its RAM to 1536 and brought it back up.� I think I started the documentum services backward.� I dont' know if it matters.� I did docbroker after pffdev.� No complaints so far.
11- EMAIL - Mr. T. designates new Diagram Repos - favorited - drop visios there.
12:30 - Stewie Griffin copied me on some Networker upgrade project they've got going on in OPS.� As if I give half a damn.
1:30 sper-dooge sent me the contact info for a guy at NW who set up LDAP on Sol 9 to auth against the NW systems.� I need to mail him and ask for his docs.� it might make things slightly simpler if I already have the right configs or at least something to compare to.
2pm - Cartman sent out the ESX dataflow doc.� no fucking attachment. jackhole.
3pm - Cartman sends out the ESX Dataflow doc.�
�3:45 - Jamie sends confirm that she has generic acct forms for rsync etc.
8am - becky gives me a list of servers that need 3 portal admin accounts added (LM Boxes)� Becky is out of the office a while.
8:13 - Hooper sends email about LDAP cutover for portal D2.� Bunch of visios and other docs.�
9am - Becky gives me a startup/shutdown script from PAN to use through the environment for WAS startup/shutdown.� On desktop.� Look at this later.
10:30 - Get CPU info for Ash regarding BTI ESX hosts by Friday.� Wants physical server CPU info.
11:30 - Portal LDAP changes in prod on Thursday will need CC ticket open.� Must do this prior to change.
3pm - Send email to Matt T. that petrel will need more ram.� Monitor is firing off errors every few days that it's coming up on threshold regularly. (97%).� I get OK to jack ram to 1.5GB
3:30 send generic account requests off to Norm for rsync and WAS admin users.� He will probably send them to our security account person
3:45 Curious gives OK that he'll take the WH/UW stuff I mailed him yesterday.
- Donna sends word that IWS was success.� Good news.
Start futzing with tickets to get SAN added to minotaur and pine for Pooh bear.�
Arch gnome Hooper wanted names for the NFS servers, I told him "homewood" and "hilton".� I think of them as hotels.
7am - Matt T. pokes Mr. T. again about my time on the cutover form Tomcat to WAS
Developer needs access to LM Thyme.� Hook a brotha' up.
Start on Demeter & hestia.� Have weird issues on boot after fixing hestia.� ended up bouncing the server & its' ok.
1pm, send email that demeter & hestia were done.
4pm Get the all clear on upgrade.� Testing continues into the night but my services won't be needed.
WH/UW project needs admin work done.� Another fucking project in limbo.� No time for this silliness, I forward to Curious and Duke to see if they can get one of the kids on it.
Matt T.� Wants to do Tomcat > WAS migration 7/1-7/15� is asking Mr. T. to lock my time.
Remembered to forward apollo downtime message off to portal admins.� oops.
MTG: 3:30 - 4pm today - Discuss timing for IWS work later this week.
Calvin the LDAP guy wants to coordinate some work with my apollo work today.� No Problem.
Mr. T. stood up a new IWS DC Test Env in LM.� zorn2-lm, guiness, killian need prompt adjustments in /etc/bashrc in this new env so we know they're iwsqa.
1pm : Apollow shutdown and remediate.� Work with Boody to get apps down, then proceed.� All goes well.� Return users at 2:22pm
Sent email to Skipper letting him know I installed the asset manager package on my target server. (naboo)� Seemed to go fine, copied the rest of the list.
We discuss rolling the LDAP changes out to QA on Tuesday.� We're locked in from 11am-8pm Tuesday for my changes plus rollout of the IWS work.
8am mail from Mr. T.� forwarded chain
Environment audit.� Were business requirements appropriate and was "quality delivery" achieved.� This is regarding the failed Ruby/Rails project RTB.
RTB was killed because of issues bringing it in-house.� But they still want to do Ruby/Rails elsewhere.� There is another project BTI to do just that, but it isn't related to RTB.
Mr. T. replied that I had solved the template issues with bringing it in-house, but by the time I was able to get around the problem, they'd already decided to terminate the project due to the cost.� (Good enough as it is)� Asked me to confirm.
My reply:� XXX, you are correct.� The environment is standing, there is 500GB of SAN attached and it was ready for deployment when the project was killed.� I've been waiting final word on decom/reclaim for destruction of the env.
9am Remembered to send Becky an email telling her I fixed the outbound email issue from last night.
10- Slick sent email with an NFS on ESX pdf.
10ish - Finished reconciling and installing packages for Pooh Bear on delphi.� LM RHEL5_x64 beta Oracle test box.� Let him know.
2PM Portal LDAP Meeting� dial in
LDAP boxes are hideously downrev in prod.� Currently set to dual cpu with SMP kernel, need to be set down to single CPU/non-smp.� Update packages, patches, errata, kernel, bounce, recompile tools, restart networking, remove tools & kernel source, and done.
Other changes going on too.� New rollout.� Discussion of when/where/order, etc.� They agree to let me roll first with my changes, I can do it in 1 hour, 2 at most.� They'll give me a window next week.� Monday.� Get it done in Dev.� Dev server is apollo over on texoma.
I sent email at 3pm sic it app dev web with notice for downtime of 1-2:30pm on Monday for Apollo.� Set lock on calendar time.
If Apollo goes oka, proceed to demeter & hestia on Tuesday.
Oliver says I'll get call to exchange laptop next week.
9Am - 4pm All day working session on ESX remediation.� yay.� lunch provided.� Slick and Skipper were there.�
I had a 'flexible workplace' meeting today but I bailed on it because I had to do this ESX thing.� It was a whole lot more important.� I did send a late decline message answering the question they asked.�
Email from Matt T. asking about the Tomcat to Was Migration for Prod.� Someone says that our environment doens't recover well after "change controls".� Needs to know why.
This is the first I've heard of that.� Nobody has ever told me that we have any issues after change controls.� What change controls?� What kinds of problems are we seeing?� What do you mean Tomcat doesn't recover well after a change control?� WTF?
I shot an email back stating as such.�
Saw Matt in the hallway of P2 near war room and explained the situation with his email.� It's all over the place that we're having issues after CC, but nobody tells ME about it?� I need to know what the issues are.� He says after recent change control windows something has happened that caused the PFF apps to behave funny.� Tomcat specifically.� I said that other changes can't really affect their env. because they're isolated.� Other than their systems authenticate against the prod portal LDAP servers.� He will get back to me.
ESX Meeting:
All the players were there.��� Slick, Skipper, Hooper,� Margie, Cartman, Grandpa Simpson, Thug, and of course yours truly.
We spend the morning arguing over items above our process.� Discussing what items we have to provide to the architects so they can provide it to the Salty Dogs who run the joint.
We get almost nothing done other than to auger in the point that management makes bad decisions based on information they get from the architects that is apparently not based on any sort of reality because they never ask the engineers who can never build a proper environment because expectations are unrealistic.
ok.� I get it.� Let's fucking move on already.
Noonish, break for lunch.� We actually carpooled everybody together and drove over to Pita Jungle to share lunch.� That was kooky stuff.� I never met people who hadn't eaten baba ganouj before and were visibly shaken by the sight of it.�
Misc:
Next up was Mr. T copying me on a thread from Matt on estimates for time in executing the cutover from Tomcat to WAS.� (Because Ash won't support Tomcat even though he knew for 5 months that it was coming and could have prepared.)
I estimated 8 hours for my time.� Becky estimated 40 for hers.� All I really have to do is unmount the volume I have currently attached to /opt and remount it over to /apps.� Make the changes in fstab and give it a reboot.� I might drop in some patches too while I'm at it.� That should allow me enough room for Becky to add WAS to the systems and grow them a bit.�
Howard copied me on an email that went to Grandpa Simpson and Cartman.� tkt454879� Needs ports open between monitoring systems & all WAS/Portal boxes.� Needs by Jun 12.� Nothing for me here folks, I don't fuck with firewalls.
Mr. T told everybody to get signed up for Sametime because I'm W@H till October and IM rules.
After Lunch, ESX Meeting:
I decided enough was enough and I got up and took control of the board and meeting.� I started a flow chart and walked us through my idea of a typical build cycle.� Our current system is nothing like this, but this is what I want to see.
Project initiate feeds to architecture, architecture needs to consult with various heads of State.� Those are such countries as SAN, Systems, Security, Network, Applications, Backups, Facilities, Deveopment, and the like.� They are nations unto themselves.
The architecture guys (I think of them as gnomes) collect the info we provide and then take it back for review.� That allows them to get more accurate estimates of time, cost, development, etc.
The Salty Dogs who run the Ship can then make a better decision about which direction they want to sail us in.� (And I have to say, the guys who run this ship are some pretty alright fellows.)
Now at that point, you get a Go/No-Go decision.� The heads of State are clued in about a new project in the spec cycle, and can gauge growth capacity vs expectations, and get a good idea of what sort of budgeting they need to consider.
Each head of State needs to know their process and have it documented.� That's what we need to do.� Everybody document what they need and where their calculations are and what the dependencies are and get back together next week, Friday the mother-farkin-13th to discuss.
We get unanimous approval of my process and concepts, agree on the meeting time I propose and we're done for the day.� Meeting adjourned.
MTG : Portal LDAP slowness troubleshooting Friday 6/6 2-3pm
Sent email to Oliver about swapping out my laptop from an x60 to a t60 so I can get a second monitor with a decent resolution.�
4:13pm Slick sent visio & meeting minutes from the meeting
Drive home.
Becky asked about sending email from LM servers Thyme.� She's getting an error while trying to send email to Cheesedog.� Error is 'sender is not ok' .� I setup sendmail on those systems earlier in the week.
At first I thought Cheesedog's name was misspelled but then I read the error again.� Sender not ok means that Cheesedog's return address was the .com address while the domain of thyme was the .net address.� I just have to add the domain in the /etc/mail/access file.
localhost��� ��� ��� OK
localhost.localdomain��� ��� OK
127.0.0.1��� ��� ��� OK
blahblabhblah.com��� ��� OK
Then restart sendmail. It will rehash that file to access.db which will tell sendmail they're OK to relay.