TechX meeting notes
From CEDPS
Telecon 10/10/08
Attending: David Alexander, James Matykiewicz, Dan Gunter, Keith Beattie
Progress:
- MySQL database setup on osp w/accounts for user 'techx'
- Jeff Porter helped with an osp account so James cann ssh-tunnel the web portal from techx-land
- After some tweaks, it seems that the portal can connect, although not over https (for unrelated reasons)
To-do:
- (LBNL) Check what is getting forwarded from pdsfgridxxx. Need:
- SGE logs
- GRAM logs
- (LBNL) Check MySQL perms vis-a-vis worker nodes
- (TechX) Do a sample run with UCM monitoring and let Dan/Keith know
- Verify UCM monitoring could be sent to DB
- (Dan/Keith) Collect related system logs and put them in another DB so TechX portal can query it
Next telecon: Friday, 17 October ??pm PDT
Telecon 10/3/08
Attending: David Alexander, James Matykiewicz, Dan Gunter, Keith Beattie
Discussed to-do items to link together cedps DB and tech-x portal, using PDSF runs
James has been able to do globus-job-run submits (GT2) on PDSF, so the basic plan is to
1. Get DB connectivity on PDSF and from TechX to osp.nersc.gov MySQL 2. Use Gatekeeper logs to link together the job ids from Globus with the SGE scheduler jobid 3. Add user interface elements to TechX portal to allow navigation from portal job info to CEDPS log details 4. Demo at SC! (in TechX booth)
Action items:
- James: send abbreviated info. on how to create TechX portal DB
- Dan/Keith:
- Set up TechX DB user / database / tables
- Configure mysql on osp.nersc.gov to accept DB connections from worker and front-end PDSF nodes
Telecon 7/21/08
Attending: David Alexander, Roopa Pundaleeka, James Matykiewicz, Dan Gunter
Topics:
- (Dan) informed Tech-X that Brian is leaving CEDPS as of Aug. 1st
- Agreed that a demo at SC08 was reasonable
- Tech-X "no cost extension" will last until at least SC
- Talked a bit about portal UI
- Discussed next steps (see action items):
- Main bottleneck is waiting for security clearance from NERSC to open a hole in the firewall for contacting the database on OSP
- Brent is sailing solo across the Atlantic right now..
Action items:
- Need some data for testing sooner rather than later, so one-off plan:
- Tech-X will finish instrumentation and administration needed to submit a fake STAR job to PDSF, then ping Dan with job-id, time, etc.
- Dan will find logs, forward relevant portion of the DB
- Tech-X will use this information to test UI against "real" data
