Go to file
Jan Tattermusch 0f1afec5a8
[protobuf] Upgrade third_party/protobuf to 22.x (#32606)
The very non-trivial upgrade of third_party/protobuf to 22.x
This PR strives to be as small as possible and many changes that were
compatible with protobuf 21.x and didn't have to be merged atomically
with the upgrade were already merged.
Due to the complexity of the upgrade, this PR wasn't created
automatically by a tool, but manually. Subsequent upgraded of
third_party/protobuf with our OSS release script should work again once
this change is merged.

This is best reviewed commit-by-commit, I tried to group changes in
logical areas.

Notable changes:
- the upgrade of third_party/protobuf submodule, the bazel protobuf
dependency itself
- upgrade of UPB dependency to 22.x (in the past, we used to always
upgrade upb to "main", but upb now has release branch as well). UPB
needs to be upgraded atomically with protobuf since there's a de-facto
circular dependency (new protobuf depends on new upb, which depends on
new protobuf for codegen).
- some protobuf and upb bazel rules are now aliases, so `
extract_metadata_from_bazel_xml.py` and `gen_upb_api_from_bazel_xml.py`
had to be modified to be able to follow aliases and reach the actual
aliased targets.
- some protobuf public headers were renamed, so especially
`src/compiler` needed to be updated to use the new headers.
- protobuf and upb now both depend on utf8_range project, so since we
bundle upb with grpc in some languages, we now have to bundle utf8_range
as well (hence changes in build for python, PHP, objC, cmake etc).
- protoc now depends on absl and utf8_range (previously protobuf had
absl dependency, but not for the codegen part), so python's
make_grpcio_tools.py required partial rewrite to be able to handle those
dependencies in the grpcio_tools build.
- many updates and fixes required for C++ distribtests (currently they
all pass, but we'll probably need to follow up, make protobuf's and
grpc's handling of dependencies more aligned and revisit the
distribtests)
- bunch of other changes mostly due to overhaul of protobuf's and upb's
internal build layout.

TODOs:
- [DONE] make sure IWYU and clang_tidy_code pass
- create a list of followups (e.g. work to reenable the few tests I had
to disable and to remove workaround I had to use)
- [DONE in cl/523706129] figure out problem(s) with internal import

---------

Co-authored-by: Craig Tiller <ctiller@google.com>
2023-04-12 18:43:58 +02:00
.bazelci Remove ubuntu1604 from presubmit.yml (#26587) 2021-07-15 09:22:45 -07:00
.github [infra] Consolidate auto-tag and check-title GH actions (#32824) 2023-04-06 11:19:03 -07:00
bazel [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
cmake [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
doc [doc] Remove the suggested format for health check name (#32841) 2023-04-11 09:04:47 -07:00
etc Update root pem certs (#27539) 2021-10-01 04:46:12 -07:00
examples [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
fuzztest [fuzzing] Roll forward dep on fuzztest (#32667) 2023-03-21 13:37:32 -07:00
include [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
spm-core-include Support swift package manager for grpc-core and grpc-cpp. 2020-10-28 14:53:37 -07:00
spm-cpp-include Support swift package manager for grpc-core and grpc-cpp. 2020-10-28 14:53:37 -07:00
src [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
summerofcode Update .cc and .md files 2019-01-30 11:24:09 -05:00
templates [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
test [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
third_party [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
tools [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
.bazelignore Rehome python bazel distribtest (#29275) 2022-04-01 15:04:50 -07:00
.bazelrc Add suggested alias for bazelrc import location 2018-10-24 23:31:54 +02:00
.clang-format [iwyu] rest of the owl: src/core/lib - excluding iomgr, gpr (#29735) 2022-06-10 13:04:47 -07:00
.clang-tidy Added readability-redundant-string-cstr (#31707) 2022-11-18 17:12:46 -08:00
.editorconfig Adding an editorconfig configuration file. 2015-01-31 06:43:40 +01:00
.gitallowed .gitallowed modification on the path of test files. 2020-02-26 15:15:40 -08:00
.gitattributes [tests] Convert core e2e tests to gtest (#32603) 2023-04-03 22:19:57 -07:00
.gitignore [Python] Remove Six dependency (#31264) 2022-10-10 10:25:22 -07:00
.gitmodules Clean-up (#31073) 2022-09-20 17:04:31 -07:00
.istanbul.yml Moved gRPC node package root to repo root, made it depend on grpc.gyp 2015-10-01 11:54:00 -07:00
.pylintrc [PSM interop] Introduce isort/pylint to the GKE framework (#29476) 2022-05-03 11:05:04 -07:00
.pylintrc-examples Update third_party/protobuf to 3.21.4 (#30377) 2022-08-04 09:39:49 -07:00
.pylintrc-tests [PSM interop] Introduce isort/pylint to the GKE framework (#29476) 2022-05-03 11:05:04 -07:00
.rspec Bundled C core with Ruby library 2015-12-18 11:18:34 -08:00
.yapfignore More pythons to be formatted 2020-01-03 22:21:23 -08:00
.yardopts Adding a .yardopts file at the root so rubydocs isn't getting lost. 2016-02-13 22:54:23 +01:00
AUTHORS [Aio] Unary unary client call barebones implementation 2019-09-11 20:37:45 +02:00
BUILD [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
BUILDING.md Update minimum MSVC version to 2019 (#32614) 2023-03-13 15:52:56 -07:00
CMakeLists.txt [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
CODE-OF-CONDUCT.md Fix code of conduct 2017-06-08 13:15:06 -07:00
CONCEPTS.md Tiny update to protocol overview doc. (#26396) 2021-09-07 14:07:56 -07:00
CONTRIBUTING.md Update note on closed feature requests with help wanted label 2020-05-05 01:13:27 -07:00
GOVERNANCE.md Add GOVERNANCE.md 2019-09-20 11:38:05 -07:00
Gemfile Bundled C core with Ruby library 2015-12-18 11:18:34 -08:00
LICENSE include full text of MPLv2 license in /LICENSE (#30115) 2022-06-29 19:13:23 +02:00
MAINTAINERS.md Update maintainers (#30111) 2022-06-29 14:24:14 -07:00
MANIFEST.md Abstract libuv implementation 2018-03-13 01:21:42 -07:00
Makefile [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
NOTICE.txt change LICENSE, add AUTHORS 2017-06-08 11:22:40 +02:00
OWNERS bG6b3V2MNxQ (#30021) 2022-06-21 08:00:32 -07:00
PYTHON-MANIFEST.in [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
Package.swift Requiring C++14 (#29589) 2022-05-12 21:17:32 -07:00
README.md doc: npm package of grpc migrate (#32041) 2023-01-10 13:57:25 -08:00
Rakefile [ruby] Fix Ruby 2.6 build (#32231) 2023-01-30 09:26:38 -08:00
SECURITY.md Add security policy doc 2021-01-22 10:38:04 -08:00
TROUBLESHOOTING.md Typo 2020-10-04 19:42:06 -04:00
WORKSPACE [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
_metadata.py [Release process] Bump version to 1.55.0-dev (on master branch) (#32743) 2023-03-29 11:03:07 -07:00
build_autogenerated.yaml [third_party] update envoy-api dependency (#32807) 2023-04-06 06:47:50 -07:00
build_config.rb Bump core version to 31.0.0 for upcoming release (#32739) 2023-03-28 11:32:35 -07:00
build_handwritten.yaml [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
composer.json update required minimal php version to 7.0 2020-11-19 23:52:44 +03:00
config.m4 [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
config.w32 [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
gRPC-C++.podspec [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
gRPC-Core.podspec [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
gRPC-ProtoRPC.podspec [Release process] Bump version to 1.55.0-dev (on master branch) (#32743) 2023-03-29 11:03:07 -07:00
gRPC-RxLibrary.podspec [Release process] Bump version to 1.55.0-dev (on master branch) (#32743) 2023-03-29 11:03:07 -07:00
gRPC.podspec [Release process] Bump version to 1.55.0-dev (on master branch) (#32743) 2023-03-29 11:03:07 -07:00
grpc.bzl Make Buildifier Sanity Test Strict (#27807) 2021-11-03 14:57:04 -07:00
grpc.def [cleanup] Eliminate usage of GRPC_ASSERT(false...); (#31757) 2023-01-11 08:50:32 -08:00
grpc.gemspec [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
grpc.gyp [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
package.xml [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00
requirements.bazel.txt Remove enum and future (#31381) 2022-10-18 14:58:30 -07:00
requirements.txt [Remove Six] Remove dependency on six (#31340) 2022-10-17 09:34:45 -07:00
setup.cfg Add type annotations to _channel.py and _server.py (#31677) 2022-11-28 11:31:07 -08:00
setup.py [protobuf] Upgrade third_party/protobuf to 22.x (#32606) 2023-04-12 18:43:58 +02:00

README.md

gRPC An RPC library and framework

gRPC is a modern, open source, high-performance remote procedure call (RPC) framework that can run anywhere. gRPC enables client and server applications to communicate transparently, and simplifies the building of connected systems.

Homepage: grpc.io
Mailing List: grpc-io@googlegroups.com

Join the chat at https://gitter.im/grpc/grpc

To start using gRPC

To maximize usability, gRPC supports the standard method for adding dependencies to a user's chosen language (if there is one). In most languages, the gRPC runtime comes as a package available in a user's language package manager.

For instructions on how to use the language-specific gRPC runtime for a project, please refer to these documents

  • C++: follow the instructions under the src/cpp directory
  • C#/.NET: NuGet packages Grpc.Net.Client, Grpc.AspNetCore.Server
  • Dart: pub package grpc
  • Go: go get google.golang.org/grpc
  • Java: Use JARs from Maven Central Repository
  • Kotlin: Use JARs from Maven Central Repository
  • Node: npm install @grpc/grpc-js
  • Objective-C: Add gRPC-ProtoRPC dependency to podspec
  • PHP: pecl install grpc
  • Python: pip install grpcio
  • Ruby: gem install grpc
  • WebJS: follow the grpc-web instructions

Per-language quickstart guides and tutorials can be found in the documentation section on the grpc.io website. Code examples are available in the examples directory.

Precompiled bleeding-edge package builds of gRPC master branch's HEAD are uploaded daily to packages.grpc.io.

To start developing gRPC

Contributions are welcome!

Please read How to contribute which will guide you through the entire workflow of how to build the source code, how to run the tests, and how to contribute changes to the gRPC codebase. The "How to contribute" document also contains info on how the contribution process works and contains best practices for creating contributions.

Troubleshooting

Sometimes things go wrong. Please check out the Troubleshooting guide if you are experiencing issues with gRPC.

Performance

See the Performance dashboard for performance numbers of master branch daily builds.

Concepts

See gRPC Concepts

About This Repository

This repository contains source code for gRPC libraries implemented in multiple languages written on top of a shared C core library src/core.

Libraries in different languages may be in various states of development. We are seeking contributions for all of these libraries:

Language Source
Shared C [core library] src/core
C++ src/cpp
Ruby src/ruby
Python src/python
PHP src/php
C# (core library based) src/csharp
Objective-C src/objective-c
Language Source repo
Java grpc-java
Kotlin grpc-kotlin
Go grpc-go
NodeJS grpc-node
WebJS grpc-web
Dart grpc-dart
.NET (pure C# impl.) grpc-dotnet
Swift grpc-swift