Little Plastic Castle

- Today is an IN the office day

- I have Dr. Appt at 11 this morning in Scottsdale.� Since my office is up here near my dr, I came in.

9:45 - Added 99GB datastore to marriot.� Registered it with telstar and updated.� Rebooting to update packages.

--

The dr visit wasn't so good.� I will be out for a day, maybe more.

--

I love my job, and the people I work with are becoming good friends.� Thanks for picking up my assignments in such a hurry.� I will be back to work as soon as I can.�

~coraline blue

9:25 - We has IWS monitoring this morning!� WOOT!� Thyme LM 215 is now Thyme LM 87.�� CPU is idle but memory is already showing loaded:

Mem:�� 3116240k total,� 3102500k used,��� 13740k free

Talked with Gunslinger about it and he thinks the JVM garbage collection hasn't ran.� Test officially starts at 9:30.� I'll run SAR & monitor iostats.

9:55 - Call from Duke, Margie, and Baby Huey re tkt 464174 to add 250GB luns to giant/itan/pine on Thursday.� Duke says DMX 3 cutover is scheduled for Fri, so they want to go ahead of me and cut over to DMX3.� Then have Margie assign these luns and let me do my work.� The DBs will be down anyway.� Sounds fair to me, I'll talk with Gunslinger and get him to move the ticket and fix the language because it's all fucko.

10:05 - Talking with Mr. T. regarding the DMX cutover and the delays its thrown into our work.� I guess he talked to the trio either just before, or just after me.� He's asking questions about why this disk wasn't added a month ago and I confirmed for him that the delay is because of the trio and the cutover cluster-fuck.� He's off to a meating but will get back to me after lunch.

- Make sure we discuss the IWS perf tests and the huge blocks of time it's taking.� I have users screaming about access problems, need to re-write and re-engineer a content promotion system because the lack of root access is cramping people's styles.

- I have to get the NFS work done, and I need time to go through and remediate and actually ENGINEER some solutions instead of running around putting out fires and band-aiding this fucked up portal.

10:10 - the IWS tests still havent' started.� They block large chunks of my time, then start late.� bastages!

0- I have 3:30 appt today with Sofya

0- I have 11:30 apt with Dr. Gary on Wednesday

10:40 - IWS tests cancelled

11:00 - Deployed VM Marriott on seer.� Req. IP from Grandpa Simpson.

11:10 - lunch - salad & filled up the tank in the Roo.

12:45 - customizing Marriott.

Skipped Friday entry because all I did was roll LDAP to QA after 5pm, other than that I took the day off.

7:30 - Phone calls started immediately.� Nobody can get into QA.� I knew it was going to happen.� Seems to be an issue with E-Dir sending Usernames in CAPS.

-- Spent the ENTIRE day working on QA LDAP problems.� After having Cartman unblock ports 27366, things got a little easier.

-- Interesting side note, Pegasus gets _really_ fucko when it can't contact its authentication host.

- IWS Perf tests all fucking week long, Cutting LDAP into PROD on Thursday (NIGHTMARE WARNING!!!)

- Floated through the shop and did chmod 777 on /home/trans that's where I'm telling portal admins to drop files as they have to move them around instead of $HOME.� I'm still working on Marriott & Hilton.

Today is someone's birthday and I can't remember who it is.� Happy Birthday whomever you are.

- More problems with LDAP in portal dev, but they should be fixed at this point.� The problem only appears on RHEL3/u9 boxes that use Winbind for SAMBA mounts _and_ authentication for users against LDAP/AD.� Turned out to be userID numbers.� Hoops wrote it up and dropped it onto the wally share.

- Back and forth on the date format issue again.� Explained to everyone my understanding of the LC_TIME flag in locale.

locale -c LC_TIME shows how the LC_TIME settings were compiled using localedef for the specific locale. (In my case en_US)�

If you set a variable LC_TIME in /etc/profile, you set it to something like LC_TIME='dutch' or LC_TIME='en_US', or LC_TIME='en_UK',

then whatever program is calling the LC_TIME variable to find out how to format something, it goes out to /usr/lib/locale/en_US/LC_TIME and reads the formatting orders.� But that affects the entire system.

12:00 - Talked with a couple of friends and organized a jailbreak for Saturday.� We're going to go north of Flagstaff and hike a few miles around some extinct volcanos.

- Mon-Chi-Chi still has 'turnstone' on a list someplace even though it was decomm months ago.� Informed him as such.

- back and forth with Pooh over Delphi phys and Oracle.� Looks like my simplest solution is to rebuild the machine and then P-to-V it.

000 - Maintenance window tonight

-- Some MOTHERFUCKER shut down VDI while I was in the middle of working on giant,titan,pine.� Editing sd.conf and lpfc.conf to set up the new dmx3.� I almost fucking came _unglued_.� Called and talked with DC, he says there was a change ticket open and that's the proper notification.� Fine.� My solution?� I'M NOT FUCKING USING VDI ANYMORE.� If they can't send a shutdown warning prior to ripping the systems down, I'm done with it.

-- The same assclowns who took down VDI took down Dilbert too.� you BASTARDS.

-- Issues with the disk grow on the cluster.� More to the point, issues with the cluster.� All notes marked private.� After portal came back up, Pooh tells me the DB isn't open and I have to recycle it.� So I hagrp -offline the group and then bring it online again, everything worked fine.� Didn't even interrupt WAS, but probably because nobody was using it at the time.� Biker Babe was happy.

- DMX cutover was a fucking nightmare.� Mac and Margie worked on it while Chops kept interrupting and making everyone nuts.� I just tried to listen and learn.�

- Talked with Cartman and finally got him to admit that Grandpa Simpson is fucking incompetent.

- Talked with Slick ~midnight.� He'd gotten a few calls from The Thug.� Incredible.

10:10 - First chance to update this morning.

-- Mandrake server has issues.� Have to reset the VM because I can't get logged in.� After it's back up, Biker Babe says the app won't start:

could not connect to demeter on port 27135
couldn't bind port 20080, 20081

found /var 100% on demeter.

-- Team meeting - discussing the DMX disaster

-- the E drive on ntqua02 is full, talked to Thug about it and he's trying to get the right people on it.� (it's a windows box, and I don't do windows)

-- IWS perf test for today - delayed - they want me to check out and chart Thyme LM 215 but I haven't got time.� Too many fires so I bailed on this today.

- Staph Meating healthcare stuff pissed me off.� Made some phone calls but nobody gives a damn.� feck it.

- Sitescope is yelling about mountpoints for WICK systems.� PM to Tequila to check it out.� Tell him to df -h then mount -a and it'll probably fix it.� He said it didn't change when he did it, so it was already mounted.� Dunno.� Told him that a good PR move would be to call CarrotCake and ask if the servers are working properly because we're seeing an error in monitoring.� She'll love that kind of attention.� He took my advice.�

(always heed suck-up advice boys and girls, customers both internal and external like to know that their highly paid engineers are paying attention to their needs.� It's good for the career.) ((and I can bet Tequila didn't open the conversation with "Coraline said there might be an issue with your servers..."� But I don't mind.))

3:30 - Went through DEV and straightend out the final LDAP issues.� Changed the DN's and put the sudoers file into place.� With the root password changed, users are accessing the systems via admin accounts.�

Got the OK to do SWT on Friday.� Hoppy is out in a training class but he'll VPN in tomorrow and stage the ED systems.� After 5pm on Friday (Dark Weekend anyway), I'm bouncing the SWT env and verifying connectivity.

- Working on setting up marriott and hilton

- Pooh Bear couldn't get into phys Delphi but I got the IP from Mr. T. and gave him a new password.� He can't find apps, but I think it's at hda13 which wasn't mounted.� The /u partitions are most likely mounted wrong, so I need him to look at what we have and just tell me which goes where so I can fix it for him.

- Mandrake has been fucko all day and reset multiple times.� I finally got some time to look at it and found webseal had run away and was bleeding the system to death.�

ps -ef|grep webseald|awk '{print $2}' |xargs kill -9

-- By the way, Becky is back to work.� She's doing w@h for this week but will have a presence in the office next.� Mr. T. never did give me her address so I'll have to make a trip in next week to give it to her personally.� Also want to get something for Chez, who got back from Vacation today.� (I'll probably give her a new laser pointer so she can play with Smalls.)

3:50 - Mr. T. took the DMX migration off of Slick's plate and mine.� PD2 and ESX Remediation are top priorities.� Margie is on her own, and if it breaks in half THEN it's ALL HANDS ON DECK.� I probably owe some thanks to Skipper.

-- This is a recap note for yesterday and is post-dated

--� Morning started slow with a BTI meeting, but my afternoon schedule was quadruple booked.� I had :

- my '1-1 meeting' ; EMC Lunch; EMC Presentation ; PAM/LDAP Meeting ; Communications ; DMX Migration Test ; Blackbird ; and IWS R3 Perftest

all scheduled from 1pm - 5pm.� I knew there wasn't any way I was going to do all that from home so I packed up and left for the office at about 10:30 and arrived onsite at 11:35.�

09:35 - Drove into the office this morning.� Mr. T. needs me to roll the delphi LM image out to a physical.� He ordered the 64 system on Friday but it hasn't shown up as of yet so I'll delay that a bit.

- Must open ticket now for giant/titan work this thurs.� (tckt� 462369)

- Clarity� (47)

- haydn has been throwing warnings all weekend about full drive space.� Check with Tequila & Chops to find out wtf is going on with that.

10:40 - 64 isn't here yet.� Stopped to see Cartman & Grandpa Simpson.� We'll do lunch today.� Walked across the street to find Mac, Tequila or Chops just to say 'hi', but they weren't at their usual haunts.� Doesn't look like Mac is even in for the day.

-- Becky is on Sametime.� She'll be back in the office on the 21st.� I'm going to send a note to Biker Babe, Country Boy, and a few others to see if we can make a lunch date.

2:50 - Went to lunch from 11 to 1.� When I got back to the office the new Delphi 64 phy server had shown up and I started working on it with Mr. T.� The first & second drives laid down just fine, but there appears to be a problem with the ghost image of hd3.� So we have to roll the image again and see if the problem goes away.� We started that around 2:00 or 2:30 (Short term memory loss) and it's still running.� Not even 1GB of the 6GB partition rolled up yet.� This is going to go for a while.

08:15 - (ch)InkPen sent ST message about odysseus and hypnos.� Apparently they aren't communicating with the backup server.� (I'll have to check nsr to see which server they're going to, but they're nonprod so probably brahms)�

- Logged into odysseus and the first thing I tried to do was reverse lookup on haydn or brahms and neither will resolve.� I look at resolv.conf and am just completely bewildered by what I see.� The search line is referencing a domain we don't even populate.� The resolver is 1 digit off.� Who does this shit?� How long as this been fucko?� Did it EVER work?

9:10 Looks like ESX Host Druid just crashed.� Called Slick & left VM, then called Grandpa Simpson.� He's in that 9am LM presentation that Mr. T. is doing and I was going to call into but got sidetracked with this.� Druid is prod.

-- Trying to access dckvmmgt.� Can't get there from desk.� Go in from Fairbanks and the java app starts but when I try to log in, it says "remote host not responding".

9:45 - Squirrelface says he can get logged in, but he's going in from renton NJ.

9:50 - Grandpa Simpson seems to have just restarted Druid and all the vms on it.� Looking in the message logs of druid I see nothing unusual.� Awesome.

10:00 LDAP/PAM Meating.� Skipper wants to push to QA next Thurs.� I blocked off 4 hours on my calendar to do it.

10:30 - PFF - SS called me to do code migration.� I asked him why I'm doing these anyway because the person who's going to manage this app once it goes live is the person who needs to know how to do it.� I asked Matt T. about it in ST and he sent the full text (misspelling and all) to Rene and Watts.� What a jackss.� Never quote someone's ST messages unless you ASK THEM FIRST.� (or at least fix their lazy spelling errors.)

- SS is supposed to call back at noon to complete the work.

12:00 (ch)InkPen opened ticket 462074.X for me to look at odysseus and hypnos.� I fixed their resolvers and closed the ticket.� Hopefully that fixes the problem.

-- Most of Thursday's notes were private and dealing with LDAP and SAN (DMX) conversions.

-- LDAP successfully rolled out to Dev Portal environment.

-- Staph-o wants me to set up monitor accounts in the LM gold and the LM IWS boxes.

08:10 - Call from Gunslinger about the IWS perftest this morning.� The phone rang the instant I sat down at my desk.� I guess this was to start at 7?� Dunno, I know I wasn't the only one to show up at 8:10.

- Started monitoring on pine, olive, spruce, and thymeLM 135.

- Thyme is choking within just a few minutes of the test.� Swapping.� Memory is set to 1gb.� Get the ok from Gunslinger to bring it down and jack the ram to 3gb.� (Country Boy said that the JVM Heap alone is supposed to be 2GB.)

- Bring server down & up the RAM.� Undeploy first.� Pushed it to 3072 and restart, IP change to 215.

9:10 - Biker Babe says the thyme ovqa box is having the same problems.� I shut it down and up it to 3gb as well.� IP change to 218.

-- Squirrelface still wants the RHEL4 box spun out to workstation on his desktop & I told him that his manager won't allow that.� (He should know this, he's the head tech on the Risk Mgmt team)� Told him I can spin one out in LM for him to "play with samba and winbind" on.

9:30 - Team Staph Meating.� Mid-years are due in a week.� Grandpa Simpson said he hadn't even started pulling the images that I asked for yesterday.� Must need a new onion for his belt.� He thinks we use AS, I had to tell him it's ES and then explain why.

-- Mr. T. said something about it taking Grandpa Simpson and Cartman bloody ages to push firewall rules because apparently there are bazillions of them that need changed.� I made the crack, "That's weird, DannyBoy could always do it in just a few minutes."� Slick cracked up, nobody else got it apparently.

11:30 - Testing is done and Gunslinger wants everything in spreadsheets with graphs.� Righty-o man.� righty-o.

11:45 Margie called.� She wants to know if I've done the filesystem grow on giant, titan, and pine yet.� I haven't.� She says to go ahead and grow giant & titan on Thursday, but Pine will have to be done after they do their SAN work Thurs night.� I'll coordinate with Mac.

12:00 - I'm getting food.

1:34 - Just got off the phone with Slick.� Apparently The Martian talked with him and Hoops yesterday regarding our IT department's seeming lack of ability to get anything of substance "done", and the constant "roadblocks" thrown up for no apparent reason.

Slick and I are firm in our position that Cartman doesn't actually _do_ anything useful and the entire Network Engineering group (which just consists of Cartman and Grandpa Simpson), is entirely too liesurely.� They never complete anything on time, they always claim to be working ~60-70 hours per week, half the time things are done wrong, the other half they "forget" to do them at all.

Try to FTP a file out of our company and into a vendor.� It can't be done.� Try to move an image from point A to point B in the environment, it can't be done.� THe VLANS are all mismatched, VM's are moved around to locations where they won't work, consoles aren't connected, and the entire layout of our network is simply lunacy.

We can't get LDAP working from pan to apollo and they're on the same goddamn esx host.� There is no excuse for this.� If these two are working 50 hours a week, I'd like to have some progress to show for it.

What _really_ sucks about this is the fact that I LIKE both of them.� I LIKE Grandpa Simpson and Cartman on a personal level.� I think they're both fun guys to work with, and we've done a couple of things away from the office just because we're friends.� I just can't understand why they won't get on the ball and get some work done too.

-- See Private Note Regarding Giant/Titan/Pine

-- for SAR data files with -d option (disk)

#!/bin/ksh
cat sar-d.system.date|egrep "^[0-9]|md" |
awk '{
if ( NF > 7 ){
� print $1
� next}
print $0}'

Frack.� The tickets to the Mercury game today are for 12:30 in the afternoon!� I can't go to that!� WTF?

--� BTI meeting was short, IWS Testing cancelled, PFF has nothing on calendar, and PAM/LDAP is going to be held late.

- I setup a script to auto-start SCS on documentum when it reboots.� I didn't even test it, but I sent an email to Tequila & Chops to drop it on all of the WICK boxes.� I copied Mr. T. and Carrot Cake because Mr. T. asked me about it yesterday.� This caused a firestorm of emails from Carrot Cake wanting me to fix every issue in the whole environment.� I explained that I only fixed the problem because I had time, there were caution & warnings going out, and nobody else would touch it.� Forwarded her requests to Tequila & Chops.

- Chops has some bell's palsy issue or something and half of his face is paralyzed and he looks like he's had a stroke, but he came into work anyway.� What a fucking loon.� I think anyone would agree with me when I say, "If half of your face is paralyzed, it's okay for you to stay home for the day."

3:00 - LDAP Meeting.

- my guniea pig server Pan is on the same ESX host as the apollo LDAP auth server so any traffic going to apollo from pan won't leave the ESX v-switch since they're on the same vlan.

- hoops wants a copy of pan to play with.� got an IP from Grandpa Simpson and spun out Pandora.� Re-ip'd it and sent login info to Hoops & Skipper.

- Check with TAMMY: Is it okay to use RHEL5 as an NFS primary?� Will I face any problems having RHEL3/4/5 and/or Solaris 7, 8, 9 mounting their /home's from an RHEL5 NFS server?� (firewalls will be involved but will have holes punched.)

- Slick is going to ask Grandpa Simpson to pull the latest rhel5 dvd down and will find a location for it.

- Build RHEL5 Gold

- Spin clone of 5 Gold into Homewood.� Stand up Homewood on Seer with 100GB slice.

- There seems to be some incompatibility between Tivoli, EDirectory, and our version of OpenLDAP.

- Squirrelface wants a RHEL4 or 5 image to play with.� Told him to open a fucking ticket and I'll get to it sometime in August.

08:30 - Dev Portal is down again.� I found the disk issues showing up again and these things boot off SAN.� It's a little weird that this would show up on this machine just prior to the cutover.� Slick reminded me that Texoma was the original target for our cutover test and then we switched at the last minute to mage.� That narrowed it down to the prep work for the DMX cutover.� The two servers that have had prepwork done are having issues, nothing else is.� We're trying to get Margie on the phone now.

09:15 - Still looking for Margie.� After we take care of this I'm going to migrate the Dev Pres stripe over to LDAP authentication against apollo.

-- I added a 2nd monitor (19") to my personal desktop this weekend.� Now my work area looks like a spaceship cockpit with 4 monitors and 2 keyboards.� I rule.

-- By the way, I want to note that on 7/3 the Developers were told to point their CVS repositories to the CVS VIP or risk the loss of CVS access when I decomm Frodo.� I also need to note that Kratos needs a disk space increase on the CVS slice or we're going to have a real problem when everyone moves over there.� My fucking hands are tied with all this ESX remediation though, I can't do anything to expand that disk until we allocate it for them all.� What a fucking nightmare.

- Do Clarity

�1:00 - We had Margie pull that LUN she added to texoma and rebooted.� FS was corrupt so we had to manually fsck.� A couple of fucked up inodes on the /var partition were attached to lost+found, but since its var, that's nothing critical.� We bounced the server & it appears to be back to normal.

- Most of the time eaten here was trying to locate Margie.

- Started the LDAP rollout on PAN.� Files updated, rebooting the server now to see how things go.� Hoppy & Hoops in ST group chat.

2:30pm - There isn't much going on today to even log.

- I started @ home this morning by noticing Sitescope sent warnings about all of the servers on texoma.� At first I thought they probably just reported because the network�hiccupped or somesuch, but I was wrong.� All of the machines on Texoma were powered down, that means all of dev portal app was down.

- VC on Fairbanks was up, texoma still connected so I ssh out to see if it rebooted but it reported up 6 days. (since power failure)� message logs show disk errors.� I started powering the VMs back up in order, but they all shut off again every time the disk errors came by in the log.

- SMS to Slick: �'Houston, we've had a problem."

- Talked with Slick about it and we got in and looked around but all we could see were the disk errors.� I powered the VMs up again and this time they continued to run.� I took a few minutes to set a boot order for the VM's in case this happens again, talked to Country Boy and asked him to re-start the applications.

-- Discussed LDAP with Hooper a couple of times, we decided to move the cut over to Monday due to concers he has with TLS.� Late in the day he got it working and confirmed that we can do a cutover on Monday as long as we can bounce the servers once.

- Not much going on today.� The day before a long weekend, everyone bails around 2 or 3pm.�

I love my job.

7:30 - Doing the morning routine early today, drinking coffee and playing with our poor little confused cat Hiro.

- Hooper sent mail requesting the RHEL3 install media.� Replied with the RHN account to login and download the current media, and told him where the 3/6 media was in the office.

- Leaving home at 8 for the trek into the office by 9 for the meeting with Slick, Margie, et al. and the testing of Mage on the new switch.� Mage has 3 san luns assigned and will be a better test subject than Page was yesterday.� The primary function of the test is to see if the luns get out of order on reboot.

- I'm supposed to stop at AZE at 3:30 to see Sofya and the resident doctor.� I sincerely doubt I'll make it out of the office by 2:30, so...well.� whatever.� It's not as if it can be fixed at this point anyway.

- Pull a list together of all SMB mounts in the Portal and see how many are authenticating out of Redmond.� Correlate current and past mount issues to authentication master and see if there is a pattern.�

- Discuss the upgrade cycle from RHEL3 to 4 or 5 with Mr. T. today.� This will have to tie in with the openldap versions among other things.�

- Do calculations for the backup plan if LDAP rollout on r3/9 won't work.� Disk space requirements and time constraints to do the work.� ICD is pushing hard on Hoops.

12:55 - The mage test went okay this morning.� Successfully moved over to the new luns without issue, the data migration is running fine and we see no appreciable slowdown on the hosts.� DMP is working as advertised.

Chops buttonholed me regarding DMP on lavender.� While we see the multipath running (18 & 19) from lavender back to the dmx3, vxvm isn't reporting a multi path being up.� I talked this over with Mac and we decided to do an impromptu test of the situation by yanking the primary cable from lavender to see if it would failover.� It didn't.� We bounced the server with -r and it still didn't see it.� Mac and I are going to let Chops continue to work the issue since he discovered it, any resolution should be his kudos.� He'll find it, that kid is nothing if not tenacious.

Talked with Mr. T. regarding the upgrade (or the inability thereof) for our portal RHEL3 machines to 4.� We're going to wait for Becky to get back from medical leave to discuss.

2:00 - working on the SMB issues on the killian LM servers.� Started out on D.� Pointed them to Athens but it wouldn't join the domain complaining that there were no logon servers to service the request.� I specified the server and it worked:

net -d ads join -S -U

put in my password and the join completed.

Cycle winbind and smb but I can only browse to the websphere share.� I deleted the trans share since we're not using the transfer system here.�

The truly fucking bizarre part is that the [varlog] share wouldn't work as read-only.� It simply refused to share/browse and gave the error "incorrect function". Making it read/write worked. � When I changed the name to [varlogs] plural, it worked.� When I changed the name to [Varlog], singular with a capital V, it failed.� Leaving it as [varlog] failed.� Changing it to [varloga] worked.� I decided to set the share to read-only and set the name to [varlogs] and let it go.� I'm going to go work on the other killian lm server share and see if its just as fucko.

-- Need to ask Grandpa Simpson wtf is up with ns1.nonprod.� He built it as RHEL4/3 but on /dev/sdb instead of sda.� WTF did you do that for?� Does this have physical drives?� I don't think its booting from SAN.� WHY IN THE FUCK DID YOU SET NAMED LOGGING TO VERBOSE AND THEN ONLY GIVE IT A 1GB PARTITION FOR /VAR?� Jackhole.

Format the sda and put an LVM in there to expand /var.� please.� pretty please.� with sugar on top.

4:36 - last update for the day.� Moved over to killianS, the other box was killianD.� Copied the smb.conf from killianS to killianD, edited the krb5.conf file, took the extraneous entries out of hosts (STOP IT BECKY!), verified resolv.conf was pointing at fosters first, then letting fosters roll to external DNS as needed.� I set this file to share varlog as [varlog] and not [varlogs].

This time it worked as [varlog], but I ended up having to net join twice.� I also took out the password server entry in that file since authentication is set to ADS and not server.� You don't need the password server entry in that case.�

I also changed the NETBIOS name from KILLIAN-LM to KILLIAN-LMS.� This makes me wonder if the label [varlog] has to be unique if there is more than one server with the same NETBIOS name.� Seems like that would make sense.� I don't know how many servers we have with SMB mounts and are named killian.� (This is one of the drawbacks to LM, since LM allows for identical hostnames when that's normally strictly verboten)

-- Next week, edit killianS NETBIOS name and see if it'll let me share [varlog] without the 's'.

-- Fixed the login lag on Juno.� Shut down winbind and smb, there's no reason for them to be running there, I don't know wtf Grandpa Simpson was doing in the first place.

-- Don't forget to tell Chops about the NS1.nonprod plan next week.� He wants to know how I fixed Juno too, but maybe I'll let him stew till Monday.� lol.

-- Stopped at AZL to see the doctor.� She gave me a kit to work with.� Thrilling.� Have monday appt with Sofya.� I don't know why I'm doing this again.� 7PM, and only for 30 minutes.

- Scored 4 tix to the Mercury game on Tuesday night.� Auriel is going with me, I don't know who else to ask.� Perhaps my neighbor Donna would want to come along with Heather.

10:20pm:

Oh christ what a day.� I started out 30 minutes late.� That's no big deal really, except I missed a txt message from Slick saying, "Mapquest says there's a big fire by work.� Should I be worried?"� I never did find out if he was joking about that, but man I was getting nervous as I got closer & closer to the office late.

Finally I texted him back saying, "I'm not afraid of a little smoke.� But I'm running 30 late." he replys, "Me Too".� Which is a real funny between the two of us because we're always joking about how we never get into the office before 9am.� On the occasions that we bump into one another on the way in, we inevitably crack up laughing about our tardiness and the fact that nobody cares.

Once at the office I ran upstairs looking for Slick at his cube, but he wasn't there so I went across the street to the P3 building which is about 1/4 mile away in the 9:30am burning-fucking-desert-heat of 109 degrees already.� I had to go to the Security office to get a temp badge because I forgot mine and strolled around the entire half-circle of the campus building down to the stairway that leads up to Margie's desk where I ran into Slick in the hallway...just arriving.� We take one look at each other and crack up laughing.� He says, "I was just texting you to tell you where I was."� I say, "I love this fucking job." and we giggle like a couple of kids all the way in to Margie's office.

Margie isn't there.� There's a guy from XYZ there who's assiting Margie (read: doing the work for Margie), in the task of migrating over from one SAN switch to the other.� Slick and I decide to go downstairs for coffee.

Keep in mind that I had just rushed upstairs from the parking garage, ran into my desk, back out of the building, across the street 1/4 mile in the desert, into security, obtained the badge, ran another 1/5 mi around the building, up the stairs, to her desk, back down the stairs and into the cafeteria in under 10 minutes.� My metabolism was running high already on the 2 cups of high-caffiene coffee I drank on an empty stomach.� Now I'm dumping more hot coffee into my system.� I started getting icky and sweaty.� I said, "I'm running like a speed freak." to Slick, and he looks at me and says, "Yea, somebody might think something's up."

So I decided to slow down on the coffee, and went to the ladies room to wipe the dripping sweat from my brow.�

We got the operation under weigh, had it done and the meeting over in less than an hour.� Which blew both of us away, it went way too fast.� Frankenstein Hair said he has an instruction sheet for the process and wouldn't let Slick or I stop to read it and write anything down, so fuck if I know if its any good.� We're doing another test tomorrrow.

== I need to make a note about the fix for samba on zeppelin.�

-- Stop pointing samba mounts to redmond washington for authentication, move them to athens georgia instead.� Make the changes for winbind in the nsswitch.conf file if they aren't already.� all three of them matter.� then alter both the krb5 file and the smb file, recycle them and it should work.�

-- Fix the damn samba mounts on the killian LM servers for Opie.

-- see about the openldap 2.2.13 package on RHEL3/9 instead of the 2.0.27 package� Talk to Tammy about it if you have to.

-- Lunch with the CIO went well I think.� I told Joey that I was doing a lot more work than I should be, but that I love my job and wouldn't work anyplace else.� I love what I do, the people I work with, and the environment and freedoms I'm given as an employee.� And that is 100% true.� I do bitch about my job in my journal here, and I make snyde comments and jokes about people, but I really do like my job.� For all its silliness and faults.� And I think the old Salty Dogs who run the place are a bunch of nice men and women who really, genuinely care about their employees.� They show it in the way they treat us, the benefits and freedoms they give us, and the honest loyalty that they build with the people who work for them.� And I must say I think I'm lucky , and proud to work at an American Company in the United States, with fewer than 2000 employees.�

- Seriously fucko weekend.� Friday night went out with Chez for a drink or two, took her back to her car around 7 so she could meet up with Kellie to see a movie.� Didn't want to tag along so I stopped at a borders books for a while and read before driving home.

- Saturday I got up late and went out with Auriel shopping for motorcycles (Vulcan 900 classic maybe), went to the Can't Stop the Serenity charity event, had a really late dinner and stayed up half the night watching Sopranos.

- Sunday, got up and went straight to Urgent Care to see wtf is wrong with my throat.� I swear something is stuck in there and driving me half nuts.� They took an x-ray and said they don't see anything.� I should go for more xrays today but fuck it, I have too much work to do.�

- I talked with my mom & one of my brothers on IM for about half the night, watched the end of Sopranos Season 1 and episode 1 of Season 2.� Made myself a salmon fillet with potatos and mushrooms for dinner.� Some exciting life.

- Must cancel appt with Sofya today at 4.

- 09:00 - Groggy and tired this morning, can't drink the coffee fast enough.� Dr. suggested trying an antihistamine last night to make my throat stop feeling weird so I took a nyquil.� They always make me feel woogy.

- Mail from Matt T. with defects list from 6/27 testing round.� Slotted at 10:30 to discuss this and other topics with Matt & SS.

-- Gathering materials and docs & targets for dev LDAP implementation this afternoon.�

10:45 - 10:30 meeting with SS & Matt etc regarding date "issue".� Prince Chilli Longhorn is back from his trip to his home country.� He understands my point and agrees.� SS didn't even show up for the meeting.� Everyone on the call is in agreement that I'm not changing system locale settings in order to alter the short-date displayed in the app.� They will push SS to get it done in his coding or to find the resources to make it happen on the backend.

10:50 - Mr. T. showed me the new search engine he built for our docs.� This is seriously dope shit.� Bookmarked and will be used FREQUENTLY!� :)� Well done Mr. T!

2:50 - Fucking around most of the pre-noon and afternoon hours with LDAP setup in Dev.� Pan won't auth against apollo no matter what options we set up.

authconfig --enableldap --enableldapauth --ldapserver=apollo --ldapbasedn=ou=sic,o=int,o=sctsdlabbr --enableldaptls

authconfig manual setup fails.� Hoppy and Hooper both on the line.� We run through various iterations of the configuration.� Using URI instead of HOST, verifying nsswitch.conf is setup, alternating between 27366 and 389 on port, alternating between separate port line & including it with the URI.� Watching the logs shows various errors.�

-- Pull clone of Pan and give it to Hooper to muck with in workstation.�

-- Existing clone of pan on texoma, delete and reclone.� Delete didn't free disk space, talking with Slick to find out why.�

[root@texoma dx11]# ps -ef|grep ccag
root����� 1191���� 1� 0 Jun26 ?������� 00:34:13 /usr/sbin/vmware-ccagent -s -d
root���� 21335� 1191� 0 14:13 ?������� 00:00:00 /usr/sbin/vmware-ccagent -s -d
[root@texoma dx12231]# kill -9 1191 21335

-- Slick is going to blow away the clone of oceanus and see if we can get the disk to report free & clone Pan.� Ok.� Copy is working.� He suggested having Cartman check the network traffic both ways.� Sent email to Hoops.

-- Due to the power failure yesterday, I came into the office this morning.� Been doing cleanup in various environments.� PFF dev is fucko.

-- Exchanging laptop today at 1:30.� Appt.�with Bukket!

-- PAM/LDAP MUST be implemented next week in NON PROD per Skipper.

-- Call Chez when you're out of the office to go to happy hour.

1:45 - Looked at pffdev.� Remembered that I brought up the apps before the db on centaur was 100%.� (Corrupt disk, needed to find replicant state db's to rebuild from.)� Once I shut down the app on petrel & restarted it, everything was fine.

-- Talked with Matt T. regarding the date issue.� We're going to address it with SS on Monday.� He needs to take java coding lessons or something.

2:30 - Discussed PAM/LDAP with Hooper and the crew.� We're going to do dev Guinea Pig systems on Monday.� Tues & Wed are devoted to SAN work onsite.� Thursday is reserved for work on/setup of LDAP/PAM in all of QA provided the Dev test on Monday works well.

-- Exchanged Laptop.� Bukket gave me a backpack with wheels for this sucker, it's HUGE.�

-- Mr T. is going to get me Becky's address so I can send a card.

-- Talked with Stewie Griffin about various items of business around the env.� He's all hands and ready to go.� Wants me to change his nickname from Stewie Griffin to something more appropraiate like, Chops.� Because we're always busting them.

- Chez cut out around 12:30.� I was hoping she'd hang around till 4ish, but I guess she's ready to get her vacation started.� I don't blame her one bit.� Planning on calling her around 3ish & hooking up around 4 maybe for a drink.

09:30 - Been up and at it a while.� downgraded libaio on delphi for Pooh.� Had to go pull it off of telstar manually because it wouldn't up2date even though I specified the exact package.� Weird.

-- Talked with Grandpa Simpson regarding the DMX2->DMX3 move next week.� Grandpa is out for the week so Slick and I have to be onsite to experiment with a 2.5 and a 3.01 ESX conversion.� They also want us to test a physical boot from san Linux box so Gpa volunteered one of the NSint machines.

-- Matt T. wanted to discuss the date format issue on PFF dev.� Explained my reservations about that to him again, but he wants an email for the record.� Get that out today.

9:50 - Pooh says no luck.

9:55 - Accepted invites to Margie's work next Tues & Wed.� I'll have to duck out at 11 on Tuesday for lunch with our CIO.

�1:07 - Fixed the zodiac server accts for Brett.�

2:20 - P3 datacenter lost power.� We are proceeding with Emergency shutdown.

Up on time today, which is to say before 8am.� Lately I've been setting the clock for 7:30 and hitting snooze once or twice before it ticks off 8.� I'm usually up, do my morning bathroom/medicine/feed the cats/make some coffee routine and hit the chair by 8:30.

-- Yesterday I cleaned up the office quite a bit while I was mulling over the PAM/LDAP stuff I have to do.� Finished up the bulk of the cleaning/reorganizing last night/early this morning and _finally_ hooked up the printer/fax/scanner.� Aside from all the books thrown all over this room, it's actually fairly well organized.� Every shelf is cluttered as hell, but at least I know what's what.

- Chez is on vacation starting the 1st.� Her last day at the office is this Friday, I asked her to go out for a beer or two after work as a sendoff.

-- Email from Mr. T. regarding Becky's operation.� She's out of surgery and doing better.� Remind me to send her a card.

09:00 - Carcass wants something done with wick/uw.� Once again, reminded her to send those requests to the OPS guys.

09:30 - Witty Jim wants access to genseed 207.� He's already got an acct with pw set.

- Note to self.� Juno is acting a little fucko on login.� After banner/motd it's hanging for 15-20 seconds before dropping to a prompt.� Find out why.

9:45 - Pooh Bear needs me to verify that libaio is installed on delphi.� It is.�

9:50 - Witty Jim needs his password reset on genseed 207.� done.

10:15 - Reading documentation from Sun regarding LDAP on Sol 9 4/04

10:50 - Jerry faxed a stack of docs for BTI meeting coming up.

11:00 - BTI Meeting with Jerry, Ratface & Witty Jim among others.

11:45 - Sent Cartman & Grandpa Simpson an email asking for port 27366 open to centaur.

�2:15 - / filled up on LM guiness 147.� Cleared out a few files in /tmp and /root.� The disk space is still reporting 100% after rm'ing files.� Bounced server & it's down to 59%.

2:25 - Matt T. needs apache user pw on PFF dev.

2:35 - Pooh Bear says that the updated libaio package on delphi is probably the source of our incompatibilities and wants me to downgrade.� I'm going to go look for a downgrade package.

9:25 - Been up and "on it" for a while.� Kinda' spacey today.� I have a lot of things on my calendar for work and a couple of personal things I'm scheduled to do this afternoon/evening.

- I didn't shower yet this morning, I'm planning on hopping in there after my 11am BTI meeting is done.

- I'm supposed to see Sofya today at 4, which means leaving the house at 3:15 so I can get there in time.� I'm also supposed to have dinner with some folks from my legislatvie district tonight.� I set an appt at 3:15 so everyone can see I'm booked.

- I didn't get to work on Brett's systems yesterday so one of my first orders of business today is to fix the accts on LM: 83, 112, 135, 138, 153, 154, 166, 169, 174, 207, 208.

10:00 Brett's work is done.� Emailed him to let him know.

- Stewie Griffin & the Duke called me earlier today looking for a Guinea Pig for something to do with their SAN SWITCH work.�� They wanted aster & lavender, but aster is being used for the IWS project and Lavender is abandoned for now.� I sent them off to get perms from the German Student, Sad Mark, or Forbes.�

- Skipper rescheduled the PAM/LDAP meating.

-- Spent the rest of the day working on silly issues on various systems.� Bailed at 3:15 to see Sofya.