Skip to main content

Making the robots robotic

Posted by Matthew Templeton on July 19, 2011 - 11:13am

The AAVSO's network of automated telescopes, AAVSOnet, has been a challenging system to set up.  From an engineering standpoint, all of the people dealing with hardware (especially Arne Henden, Tom Krajci, Tom Smith, and John Gross) have put in an enormous amount of work to get these systems up and running, and a lot goes on behind the scenes that the average user of AAVSOnet probably doesn't see -- which is in itself a testament to how well the system works.  From a software standpoint, a lot has gone on as well.  Many of you are probably familiar with Geir Klingenberg's wonderful VPhot site where you can analyze your images.  That also took a lot of work to get it to where it is right now, and it's a wonderful tool for the community, amateur and professional alike.

One aspect of AAVSOnet that I've been working on with the staff at Headquarters has been the pipeline that glues everything together and gets data from the telescopes to you.  The processing package for all of our telescopes has grown in stages, from Arne's original IRAF and FORTRAN programs -- originally all run by hand by Arne -- to the current system where all of the processing is now done automatically via cron jobs on our computation server.  It's been a fun project to work on with our Astronomical Technologist, Doc Kinne and Technical Assistant, Sara Beck, and I'm pleased with how everything has come together.  We've got a great system that greatly reduces the amount of human intervention that goes into AAVSOnet data processing, and greatly increases the speed at which you get your data.

There's a lot that happens behind the scenes to get you your AAVSOnet data.  The local Telescope Operators have to transmit the data to us every night via ftp, and then we take over for the rest of the processing.  When there's raw data available to process, we set in motion a script that does all of the work, getting the results to the staff for review and to you for your own use.  We use a Perl-based master script to control the processing and move files around the network, and to trigger automated versions of Arne's IRAF and FORTRAN programs to do the processing work.  We also create logs of all the data processed in MySQL, and Sara Beck's Java-based Remark-o-matic image review tool greatly increases the speed and efficiency with which staff can review data every night.  What used to be a task that took Arne several hours of time per day to do on his own is now done automatically by our servers, and our staff only take about 15-30 minutes per day to do a quality check of the data.

Doc Kinne and I reached a milestone in AAVSOnet processing this week by setting up the entire system to run autonomously via a UNIX cron job.  On July 6, we had our first night of fully automated processing on one of the telescopes, the Wright 28.  The staff here used to launch the nightly processing script manually, but we finally got all of the bugs worked out to the point where we felt the server could do everything on its own.  Everything seems to check out ok, and so we're now ready to say we're "fully automated".  We'll probably hold off on switching all of the telescopes over to the automated system until after the monsoon season in the southwestern United States, but by September of 2011 I expect that all of AAVSOnet will be fully automated between the telescopes themselves and the data's final destination on VPhot or the AAVSO ftp site.  The system is such that it will also be easy to add new telescopes to AAVSOnet as they're set up.

We certainly have some other things we can automate, and also some ideas for how to improve the system, but we're a long, long way from where we were a few years ago as AAVSOnet was just getting started.  Most importantly, we've lowered the time required from Arne and the rest of the staff to get AAVSOnet data to the users.  That gets you your data faster, and makes it easier for staff to work with AAVSOnet and do the many other tasks that it takes to keep AAVSO Headquarters going.

It's been a fun project, and although my main concern has always been to automate and improve the efficiency of the system, it's been a pleasure to do some hacking and create something new and useful.  I do a lot of scripting and coding for fun during my off hours, and there's been plenty of that for Doc and I over the past 2-3 years.  But the best part is seeing that all the hard work that's been put into AAVSOnet over the past several years by so many people is working together so smoothly.  We have a few more advances that we plan to roll out in once the monsoon season ends in the southwestern United States.  Stay tuned for those -- we hope you'll appreciate them!

I won't say that AAVSOnet is quite at the level of "plug and play", but we're getting there!

Comments

The behind the scenes look at AAVSONet development and progress was really very interesting.  I was one of the early users of the AAVSONet telescopes, working mostly with John Gross and Tom Krajci.  My experiences were almost all "stellar" and I am glad to see the faster pipeline processing and turnaround time from image to data.  VPhot is a great tool (another shout out to Gier!), but I like to get reductions straight from HQ rather than download images - I find it's much faster, and it frees up my time to do the analysis, which is what really interests me.  Since I only have about three hours a day to work on that, every hour counts, and Arne and his crew have been great about feeding my hunger for data!

All of the planned improvements to the AAVSONet software and scripting are really quite exciting, and I wish all the best in continuin to improve on what I find to be one of the most remarkable achievements among many that the AAVSO has accomplished!  Much whistling and clapping from Arizona!

Best wishes,

Thom Gandet (GTN)

An obvious question arises, why not allow all (many, pre-certified?) observers to ftp their images into the system?  Not looking to go around VPhot but if its good enough for HQ, how about the rest of us?

Jim Roe [ROE]

 Your experience of robotic telescopes is very interesting; I’ve started it 4 years ago with two remote instruments in a telescope farm. Now, I try to find very easy solution for a small "go-to" telescope with DSLR camera. Many amateur astronomers have this setup and their telescope spend most of the time to do nothing. Perhaps the moon or the light pollution in the town is the most important reason of this situation. Using instruments in these bad conditions should be interesting for bright stars monitoring and for many amateur, it should be another alternative of making astronomic pictures of planet or moon.

Etienne MORELLE

Sirene observatory

Very good idea Etienne! At this time I am designing a very similar instrument as you propose capable to be operated remotely, or locally in automatised mode. I think it must been composed from inexpensive hardware, as it is interesting it would be accesible to low budget amateurs. I've selected the following hardware: an EQ-5 style mount with a goto motors and computerization kit, a short focal optical tube, refractor or newtonian, from 3 to 5 inches in diameter, an "inexpensive" astronomical cooled-ccd camera (I prefer this to DSLR, and prices are similar, depending on model; but if observers would like to make photometric profit from their DSLR they are welcome), and one V Johnson filter if possible. Total price if bought new components around 2000 euro (more or less 2500$, may vary largely depending on chosen components). This design may benefit from used parts, so costs could be drastically reduced. Running in Maximdl and CCDCommander may work finely in automated operation. Remote operation adds a lot of technical challenges. I hope to start remote use of a similar telescope as I describe above in a friend's home, mainly for experimental purposes.. I share your interest for bright star monitoring because I think this is a nice way to do useful astronomy under polluted skies. Regards Miguel Rodríguez

AAVSO 49 Bay State Rd. Cambridge, MA 02138 aavso@aavso.org 617-354-0484