Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MAST cloud dataset doesn't show level 3 data products #3066

Open
bmorris3 opened this issue Jul 12, 2024 · 1 comment
Open

MAST cloud dataset doesn't show level 3 data products #3066

bmorris3 opened this issue Jul 12, 2024 · 1 comment

Comments

@bmorris3
Copy link
Contributor

I'm trying to load a JWST level 3 observation from AWS. I run:

from astroquery.mast import Observations 

Observations.enable_cloud_dataset()

obs = Observations.query_criteria(obs_collection='JWST',
                                  filters='F090W',
                                  instrument_name='NIRCAM/IMAGE',
                                  proposal_id='2731',
                                  dataRights='PUBLIC')
products = Observations.get_product_list(obs)

The resulting products contain only levels 1 and 2

>>> set(products['calib_level'])
{1, 2}

The corresponding level 3 data products are available on AWS, and you can see them with the AWS CLI like so:

$ aws s3 --no-sign-request ls s3://stpubdata/jwst/public/jw02731/L3/t/o001/
2024-02-27 20:26:37    8177157 jw02731-o001_t017_nircam_clear-f090w_cat.ecsv
2024-02-27 20:23:57 5414328000 jw02731-o001_t017_nircam_clear-f090w_i2d.fits
2024-02-27 20:26:35   16300589 jw02731-o001_t017_nircam_clear-f090w_i2d.jpg
2024-02-27 20:26:41       4076 jw02731-o001_t017_nircam_clear-f090w_i2d_thumb.jpg
2024-02-27 20:26:31  492192000 jw02731-o001_t017_nircam_clear-f090w_segm.fits
...

Are level 3 products intentionally separated from levels 1 and 2? Is there a way to query for them?

@snbianco
Copy link
Contributor

snbianco commented Nov 8, 2024

Hi @bmorris3! I'm so sorry that this slipped past me back in July. I retried your code and it looks like level 3 products are being returned now. If you don't run into any more issues with it, I can go ahead and close this ticket.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants