S3 Connection Wizard: Globus

The Arizona State University Artificial Intelligence Cloud Innovation Center, powered by Amazon Web Services (AWS), collaborated with Globus to enhance data-sharing practices within the academic research community. As a primary solution for file transfer and publication, Globus is used by more than 2600 institutions worldwide. However, despite AWS’s extensive presence, many institutions rely on on-premise storage solutions creating barriers to efficient data sharing. This collaboration aimed to develop a simplified, user-friendly wizard to increase AWS adoption among Globus users by streamlining access and integration.

Researchers frequently face obstacles in accessing and sharing data due to disparate systems and complex workflows. The current data ecosystems, often managed on local or institutional servers, are labor-intensive, slow, and prone to interruptions. The current S3 connector available on Globus is a cumbersome 20+ step process. By developing an S3 Connection Wizard, data can more easily be shared enabling AWS flexibility, scalability, and ease of data access that researchers need. 

To address these challenges, the ASU AI CIC team and Globus co-developed a wizard interface to simplify AWS resource integration for Globus users. Initial research focused on understanding Globus workflows and user requirements, with a dedicated assessment of AWS integration points. The wizard was then designed with a clear, intuitive user interface allowing users to easily enter credentials, create or select an S3 bucket, and receive the AWS credentials necessary for Globus access. AWS Lambda and AWS Step Functions managed backend processes, ensuring smooth credential validation and resource creation. Regular user testing guided iterations to refine the wizard's accessibility and usability, making AWS integration seamless and efficient for Globus users.

Industry

This project reduces the barriers to cloud-based data sharing, providing researchers with the tools to facilitate easier, faster, and more scalable access to data. By enabling users to integrate AWS into their Globus workflows, the solution modernizes data sharing for academic research and enables new levels of collaboration and productivity across institutions. The wizard accelerates data access and sharing, making it possible for scientists and researchers to dedicate more time to research and less to logistical challenges.

 “Globus is excited to see how the new S3 Connection Wizard, from the ASU CIC, streamlines the setup process for Globus users when configurating the Globus S3 Connector with AWS.”

Vas Vasiliadis, Chief Customer Officer, Globus

Wider Application

The success of this project opens doors for broader applications in other academic and scientific settings. The wizard could be expanded to support additional AWS services, providing further enhancements for data storage, computational workflows, and multi-institutional collaborations. Moreover, the framework developed here can be replicated to support other platforms in research institutions and industries facing similar data-sharing challenges.