Skip to main content

Welcome to the Data Analysis forum!

13 posts / 0 new
Last post
David Benn
David Benn's picture
Welcome to the Data Analysis forum!

Welcome to the AAVSO Data Analysis forum!

Thanks to Rebecca for setting it up and to everyone at HQ for their support of the idea.

This forum starts with the thought: "So now that I have a time series of observations from CCD/DSLR photometry, PEP, or visual estimation, what do I do now?" 

The purpose the forum is to:

  1. discuss methods and tools for variable star data (light curve) analysis;
  2. encourage, and in some cases be a home for, data analysis projects.

In scope is discussion about the theory and application of variable star data analysis methods as enabled by tools like Period04PeransoVStar, TS, WinWWZ, in particular:

  • statistical analysis
  • data search/filtering
  •  
  • period analysis including Fourier analysis, pre-whitening, models, residuals
  • time-frequency analysis

The motivation for the forum arose from the "Project LAVA" topic that recently started on the Visual Observing forum. That topic will be moved over to this forum soon.

If you have questions or suggestions for forum content, feel free to post here.

Regards,

David Benn (BDJB)

rmu
rmu's picture
It's a very good idea David.

It's a very good idea David. I hope to learn from experienced analysers and get skills to analyse data if some day it's needed for some project.

Regards

David Benn
David Benn's picture
Hi Miguel Thanks. I look

Hi Miguel

Thanks. I look forward to learning a lot too. :P

David

daveh
daveh's picture
Data Analysis Forum

This is great!  I've been in recent contact with Dr. Hendon regarding a data mining/data analysis forum for AAVSO.  He indicated that there was some interest in this topic.

I've been involved recently with the Lowell Obseratory Lowell Amateur Research Initative (LARI) MGED project that does data mining and analysis for exoplanet transient research.  We use several analysis tools, including some homegrown tools as well as MPO Canopus (developed for asteroid analysis but still good for variable star/exoplanet analysis).  I've also used VStar and algorithms from the NASA Exoplanet Archive (Lomb-Scargle, Box-fitting Least Squares-BLS, and Plavchan PDM) for my LARI work.

For LARIMGED we use a Yahoo user group for day-to-day communications and a wiki to upload analysis results, post detailed technical information, etc.  It seems to work very well.

So, I would love to be an active participant in this forum as well as LAVA.  Please let me know how I can contribute to these forums.

 

Dave Hinzel (HDHA)

David Benn
David Benn's picture
Hi Dave Thanks for your

Hi Dave

Thanks for your post. Interesting!

I'm not sure whether you've seen the Data Mining links on the AAVSO Research Portal page. Apart from this forum, perhaps Arne was also thinking about that, among other things.

I'll post again soon to the LAVA thread re: access to documents created so far, much of which has been done by Pete Brock (see the LAVA topic) up to this point. There's plenty to be done. 

The practice of using a wiki makes a lot of sense to me. I have used them in various contexts for several years and they're hard to beat for rich collaboration.

David (BDJB)

daveh
daveh's picture
Data Analysis Forum

David,

How do we begin to do data analysis work within this forum?  Is there a database of objects we can analyze with the various tools or do we need to access observational data from other forums?

I'm very interested in getting started with this effort.  Any information will be appreciated.

Thanks,

Dave

David Benn
David Benn's picture
Hi Dave If you are

Hi Dave

If you are interested in contributing to Project LAVA, the best place to start is to post to that topic. You can look at the docs there and request access to the Google Docs if you would like to.

No other particular analysis project has been proposed in this forum yet, but suggestions are welcome.

I'm currently preparing a new VStar release (within the next week I hope) and will devote more energy to this forum after that.

David

daveh
daveh's picture
Thanks!

David,

 

I'll do just that.  Thanks again.

Dave H.

David Benn
David Benn's picture
Using the Data Analysis wiki

Hi all

Apologies for my recent silence. My son sustained a knee injury recently. The hospital stay and home care have keep my family occupied for awhile. More recently, being interstate for work and getting a VStar release out have added to the pre-occupation.

Will, Matt and I corresponded about the data analysis wiki. The end result is that the wiki we started with is still considred to be OK. To use it, you need to create a login via: 

  http://www.aavso.org/data-analysis/wiki/HelpOnLogin?action=login

This will allow you to view the data analysis pages (e.g. LAVA):

  http://www.aavso.org/data-analysis/wiki/LAVA%3A%20Low%20Amplitude%20Visual%20Analysis

but to edit (modify, add) them you will need to send an email to Will McMain (will@aavso.org) saying that you want to do so; he will change your permissions. I suspect that myself and some others may also be able to do this in the near future, so feel free to CC me on the email.

David

TRE
TRE's picture
TU Cas

What happend to the comps around TU Cas?

Ray

clkotnik
clkotnik's picture
Coursera Course - Data-driven Astronomy

I have enrolled in this course that begins 23-Oct.  https://www.coursera.org/learn/data-driven-astronomy

If you know a bit of python and wonder about applying it to astronomical data you might give this a look see.  If you go ahead and enroll, you can see the material.

best regards, 

Cliff

SFS
Data Driven Astronomy course

I had signed up for the previous version of the course in August.  Per the requirements at the time, I migrated from Python 2.7 to 3.6, including the scipy and numpy libraries (among others) and installed Jupyter notebook.  Once the course began, I found that all the programs were to be entered into their hokey online version, and that the focus was really on SQL databases. 

Note also that nothing in the course deals with variable stars, and there is little if anything dealing with machine learning. 

Alghough I dropped the course the first week in disgust, I am not recommending against taking it.  Just read the syllabus carefully so you won't be disappointed.

David Benn
David Benn's picture
Data Driven Astronomy course

Hi Cliff, Stephen

Coincidentally, before I saw these posts, I'd enrolled in the course too. I've completed the 3rd week as I imagine has Cliff.

The first two weeks are Python with a strong emphasis on numpy. The 3rd and 4th weeks are SQL and the last two weeks are Python with a machine learning emphasis.

Yes, the Grok Learning environment is a bit different but not too bad actually. They do encourage you to use an external Python environment as well. I use a Jupyter notebook for experimentation.

Is the astronomy at a high level? I suppose so, yes.

Is there any variable star content? No, but I didn't expect there to be any from the course outline.

Am I learning anything? Yes, some. 

I've been been writing Python code for about 20 years and not so long ago took a 3 day Python for Scientists and Engineers course. I've used SQL for about 20 years as well. A long time ago I developed an object-relational mapping framework (Java to MySQL) from scratch (although I argued at the time to use JDO or Hibernate). Yet, I'm still learning things about numpy, SQL etc that I didn't know. For example, I had never used the HAVING clause in conjunction with GROUP BY in SQL. Maybe I'm a slow learner or maybe I just have a healthy awareness of the scope of my ignorance. wink

David

Log in to post comments
AAVSO 49 Bay State Rd. Cambridge, MA 02138 aavso@aavso.org 617-354-0484