Skip to content

The open source ELT framework powered by Apache Arrow

License

Notifications You must be signed in to change notification settings

TheTechOddBug/cloudquery

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21,348 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

cloudquery logo

License: MPL 2.0 Go Report Card CLI Workflow

CloudOps, without the chaos

CloudQuery is a cloud asset inventory built for platform teams. Sync your cloud infrastructure metadata into your data warehouse, powering insights and automation. Unify data and provide context across AWS, Azure, GCP, and 70+ cloud and SaaS sources such as Wiz, Finout, and GitHub.

Installation

brew install cloudquery/tap/cloudquery

Check out the quickstart guide for install guides for Linux and Windows and for step-by-step instructions on completing your first sync with CloudQuery.

Why CloudQuery?

  • Specialized plugin coverage - Support for cloud infrastructure, security, and FinOps sources with normalization, rate limit handling, and more.
  • Normalized data -
  • Queryable with SQL - No more writing scripts to hit poorly documented APIs: CloudQuery makes it easy to unify and make your cloud asset data accessible.
  • Integrate with anything - Turn your cloud data into useful signals by connecting with BI tools, Slack alerts, Jira ticketing, and more.
  • Fast, powerful syncs - Move large volumes of data with high performance and fine-grained control, powered by Apache Arrow.
  • Runs on your infrastructure - Your cloud data never touches CloudQuery's servers. Full privacy, built for regulated, secure, and performance-critical environments.
  • Composable and flexible - Use the languages, destinations, and orchestrators you want. CloudQuery is built to fit into your stack, not the other way around.
  • Built for developers - Code-first, extensible plugins, multi-language, open plugin system, no lock-in. Write it, extend it, ship it.

Use Cases

Links

License

By contributing to CloudQuery, you agree that your contributions will be licensed as defined in the LICENSE file.

Contribution

Feel free to open a pull request for small fixes and changes. For bigger changes and new integrations, please open an issue first to prevent duplicated work and to have the relevant discussions first.

Open source

The CloudQuery framework, SDK, CLI, and some integrations are open source - please file an issue before opening a PR. Any code that was open source and moved to closed source can be found in the git history of this repo, or via the following links:

About

The open source ELT framework powered by Apache Arrow

Resources

License

Code of conduct

Contributing

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Go 91.2%
  • Python 3.0%
  • Makefile 2.0%
  • TypeScript 2.0%
  • Java 0.7%
  • Shell 0.3%
  • Other 0.8%