What's new in the YugabyteDB Anywhere v2.19 release series
What follows are the release notes for all releases in the YugabyteDB Anywhere (YBA) v2.19 series. Content will be added as new notable features and changes are available in the patch releases of the v2.19 series.
For an RSS feed of all release series to track the latest product updates, point your feed reader to the RSS feed for releases.
v2.19.3.0 - October 25, 2023
Build: 2.19.3.0-b140
Download
New features
- [PLAT-9071] System defined roles support
- [PLAT-9072] Create Policy (Role binding) UI
- [PLAT-9600] Customer registration - Create Built in Roles, Create users, role binding
- [PLAT-9749] UI for backup of table spaces
- [PLAT-10218] Add new GCP regions
Improvements
- [PLAT-1848] Allow custom longitude and latitude for onprem regions
- [PLAT-5227] Restore History tab in backups section
- [PLAT-7522] [dr] Support switchover/failover/rebootstrap/change standby universe
- [PLAT-8162] Add autoflags and version based validation during backup and restore
- [PLAT-8859] K8s Operator Updating Backup Status updater in backup CRD.
- [PLAT-9093] Add DevSpace configuration for Kubernetes development
- [PLAT-9378] [PLAT-10083] Changes to encapsulate YugabyteDB recommended OS versions from CSP metadata
- [PLAT-9589] Cluster create/edit should accept priority list of SKUs for VMs
- [PLAT-9674] Improved error handling for Azure VM Status
- [PLAT-9747] Add tablespace metadata in preflight response
- [PLAT-9872] Create user API changes
- [PLAT-9878] Add support to replace PG with YBDB for YBA in helm charts
- [PLAT-9992] Add task to upgrade YBDB software till localVolatile flag promotion
- [PLAT-10037] Upgrading azcopy to 10.20.1
- [PLAT-10047] Upgrade grpcio to 1.57.0
- [PLAT-10060] Accept replicated backup as argument to YBA-installer
- [PLAT-10061] Allow configuration of
yba-ctl.yml
before replicated migration - [PLAT-10084] Create Universe Level Alerts when YBA default bundle is changed
- [PLAT-10101] [PLAT-10220] Filter instances/releases/image bundles based on the arch specified
- [PLAT-10216] Perform code splitting to reduce initial JS bundle size and parse time
- [PLAT-10247] yba-installer to support python 3.8 and up
- [PLAT-10267] Add Permission name to info for UI readability
- [PLAT-10308] PVC/STS permissions to allow YBA to expand disk
- [PLAT-10323] Remove unused software version sort function
- [PLAT-10326] Add runtime flag to configure ysql/ycql for UI
- [PLAT-10330] Add guard rails for YSQL tables before disabling YSQL, move logic from tables controller to UniverseTableHandler
- [PLAT-10350] [UI] [Rotate Server Certs] Hide Server Certs tab in EIT for all certs other than self-signed
- [PLAT-10355] Added feature flag for replicated migration
- [PLAT-10358] Fully implemented "MigrateStatus"
- [PLAT-10361] Displaying the count of leaderless and under-replicated tablets in metrics UI
- [PLAT-10362] [dr] Adding states to the DR components
- [PLAT-10366] Migrate role bindings when runtime flag is on
- [PLAT-10398] [UI] Show Schedule name for scheduled backups in backups detailed view
- [PLAT-10427] Added helper function for state transition
- [PLAT-10437] Add unique constraint on role name in the DB
- [PLAT-10439] Prune universe UUID from role bindings when universe is deleted
- [PLAT-10453] Store runtime configuration in memory for API path
- [PLAT-10465] Drop support for python 2 from the node agent pex
- [PLAT-10466] Extract auto flags form autoflags JSON instead of flags metadata file for a version.
- [PLAT-10540] [dr] Disable DR APIs by default
- [PLAT] Add YBA version label to active universe task metric.
- [PLAT] Added prompt before rollback for replicated migration
- [PLAT] Adding thirdparty download steps to sbt build process
Bug fixes
- [CLOUDGA-15644] ignore conflicts when IP address exists
- [CLOUDGA-15877] make MetricStorage thread safe
- [CLOUDGA-16115] wait for setMetadata to complete when updating boot script
- [PLAT-3192] Allow basic auth + https for Prometheus in Replicated environment
- [PLAT-3192] Unset metric auth params from application.conf
- [PLAT-5621] [Server cert rotation] Bug fixes and improvements
- [PLAT-6683] script for OCP helm chart certification
- [PLAT-6808] Editing user visible error message.
- [PLAT-7342] Disable Edit Universe when other operations are in progress
- [PLAT-7568] UX | Start Node shows universe name if failed task is retried instead of node name
- [PLAT-7627] Fixing the schema for kubernetes overrides
- [PLAT-8161] Table List API returns tables only when master nodes are in queryable state
- [PLAT-8187] [PLAT-9989] Ensure deep link to table level metrics has a default tab
- [PLAT-8286] Limit number of Volumes per Node provisioned by Provider
- [PLAT-9066] [PLAT-9067] [PLAT-9599] Authz engine changes, Annotation changes needed for Authz, Runtime config changes
- [PLAT-9111] Preflight check for disk space before replicated migration
- [PLAT-9179] Fix the restore as part of
yb_platform_backup
script - [PLAT-9465] Switching all clouds to hard reboot on failure
- [PLAT-9467] Table List API returns tables only when master nodes are in queryable state
- [PLAT-9471] Allow retries of auth enabled universe creation with default passwords for YBM
- [PLAT-9486] [yugabyte] Write to files & run sync in liveness probe
- [PLAT-9588] User cannot reset timezone to default
- [PLAT-9607] Turn off master operation completion check as it's implemented with wrong RPC call
- [PLAT-9645] Remove the API for Import Universe feature
- [PLAT-9701] API to get user permissions on resources
- [PLAT-9769] Improve YBA UI software upgrade logic and fix existing bugs
- [PLAT-9772] Add a button to clear the OIDC configuration
- [PLAT-9775] Default value for Region fields are set to different values
- [PLAT-9814] Do not garbage collect the customer task which is still being referred in the universe task or the last task for a provider
- [PLAT-9943] Add KMS configuration UUID to universe details when transitive restore from EAR enabled backup.
- [PLAT-9950] Nginx upgrade version to v1.25.1
- [PLAT-9951] Up-version Prometheus to 2.46.0
- [PLAT-9959] [PLAT-8178] Primary cluster link is not working in RR, Trim spaces at beginning/end of search
- [PLAT-9977] Fix cryptography compatibility on yugabundle
- [PLAT-9990] Allowing YBA-installer to work with arbitrary umask
- [PLAT-10007] change YBC temp directory
- [PLAT-10011] Moving between instance types in OnPrem env does not change volume size
- [PLAT-10022] migrate https cert from replicated
- [PLAT-10023] [PLAT-10054] Rollback from replicated migration
- [PLAT-10024] Ensure portion of metric charts can be selected to view finer data points
- [PLAT-10029] Fix flags creation for k8s universes
- [PLAT-10034] Show Retry Task option in Universe Overview page
- [PLAT-10039] Update node exporter version
- [PLAT-10041]Upgrade net.minidev:json-smart to 2.5.0
- [PLAT-10044] update fabric8 to 6.8.0
- [PLAT-10045] Bump up certifi version
- [PLAT-10052] Disallowing clean during replicated migration
- [PLAT-10062] Make single AZ (multi-node) clusters the default placement in internal YBA test portals
- [PLAT-10066] Disable JWKS button is there is version mismatch
- [PLAT-10072] Fix limited perf recommendation columns size
- [PLAT-10079] Bump up postgres version
- [PLAT-10080] YBA-installer to work on python 3.10 and 3.11
- [PLAT-10083] Fix the bad master merge
- [PLAT-10086] Replicated Migrated Finish command.
- [PLAT-10087] Fix UX issues for OIDC multi-line conf
- [PLAT-10088] The node_exporter can not update the metrics because of the permission issue. version: 2.18
- [PLAT-10089] testing migration failure in itest
- [PLAT-10092] Slow Query | UI Breaks if sorted column is removed
- [PLAT-10093] Do not apply metric specific filter overrides to other metrics
- [PLAT-10094] Adds sslContext to nimbusds HTTPRequest client as part of OIDC <-> custom CA store integration
- [PLAT-10096] Pass the arguments to transfer client CAs during DB upgrade
- [PLAT-10101] Ignore AWS instance filtering based on arch
- [PLAT-10103] UI crashes on Landing page
- [PLAT-10104] Add checks related to B/R and PITR while configuring DB APIs
- [PLAT-10107] Specific Flags per Process and per AZ are not inherited by RR even if inheritFromPrimary = true
- [PLAT-10115] Image Bundle migration fix when primary & RR clusters are configured with different providers
- [PLAT-10120] [PLAT-10123] [Role API] We should not create Role if name is empty
- [PLAT-10128] [PLAT-10132] [PLAT-10134] [Role API] All Prerequisite missing permissions are not returned in one call
- [PLAT-10141] [PLAT-10143] [PLAT-10150] [RoleBinding API] Add validations for resourceDefinitionSet
- [PLAT-10142] Modify confirm OIDC disable text
- [PLAT-10156] mask certContent in audit logs
- [PLAT-10157] Kubernetes Operator Generic Status Updater
- [PLAT-10167] Log the error in azure/utils.py get_host_info() function
- [PLAT-10172] Improved yba-ctl install idempotency
- [PLAT-10180] Fix full backup schedule backlog
- [PLAT-10190] [dr] Fix delete PITR configuration conflict with txn xCluster configurations
- [PLAT-10206] Restrict usage of old password as new password during password rotation for DB Apis
- [PLAT-10211] Fixing Permissions for YBA upgrade to work as expected on k8s with files created with older permissions
- [PLAT-10212] KMS configuration expiry is not refreshing
- [PLAT-10225] [Server cert rotation] Bug fixes and improvements
- [PLAT-10229] [PLAT-10230] Edit KMS configuration errors
- [PLAT-10231] Add target universe UUID, Backup details and table type to the restore API
- [PLAT-10231] Add target universe UUID, Backup details and table type to the restore API
- [PLAT-10232] YBC Upgrade fixes and improvements
- [PLAT-10240] Fixing resource usage calculations for k8s resource spec based universes
- [PLAT-10243] Overrides for cgroup size are not applied during provisioning
- [PLAT-10252] Make app logs the last component to be downloaded
- [PLAT-10254] Fix GCP provider host credential handling
- [PLAT-10266] Fix YSQL auth issue for K8s universes
- [PLAT-10268] Don't allow role deletion if role binding exists
- [PLAT-10270] Fixing boundary conditions for the resource spec
- [PLAT-10280] Fix postgres server check while enabling YSQL auth
- [PLAT-10293] [OS Patching] New Node Re-provision failing
- [PLAT-10298] Block Update/Create KMS operation if permissions are insufficient
- [PLAT-10301] [PLAT-10303] [PLAT-10304] [PLAT-10310] [Server Cert Rotation] Bug fixes and improvements
- [PLAT-10307] Increment YBC version to 2.0.0.0-b14
- [PLAT-10308] Ignore permission error when validating volume expansion
- [PLAT-10311] [PLAT-7272] Fix Disable Enable button while enableYSQL is disabled, flags reverted to NPE while validating flags
- [PLAT-10313] Fix NPE for missing nodeUuid for under-replicated tablets check
- [PLAT-10315] [PLAT-10328] [PLAT-10329] [PLAT-10334] Bug fixes and improvements
- [PLAT-10322] Remove contact support in Node Agent Status pop-up
- [PLAT-10338] [UI] Fields do not reset after successful creation of AppRole based configuration
- [PLAT-10338] [UI] Fields do not reset after successful creation of AppRole based configuration
- [PLAT-10349] [PLAT-10278] Restrict users from disabling db APIs when xCluster configuration exists and fix YSQL password rotate.
- [PLAT-10351] [PLAT-10408] Remove Instance Type and display number of cores and memory in cluster overview
- [PLAT-10352] Reverting [PLAT-7272] changes
- [PLAT-10359] Use default replicated configuration values from app-config view
- [PLAT-10370] Don't eat up exceptions in SetUniverseKeys sub-task
- [PLAT-10375] Missing memtable metrics is showing NO Data
- [PLAT-10377] Fix under-replicated tablets check for software upgrades
- [PLAT-10387] Some subtasks are skipped on add node action
- [PLAT-10388] Fix K8s resource spec for custom resources
- [PLAT-10405] Avoid gulping exceptions as part of provider delete
- [PLAT-10406] Fix YBC backup configuration object creation for encrypted universes
- [PLAT-10419] Pass schedule backup parallelism in GET schedule API response
- [PLAT-10421] UI shows undefined for password policy. Show default values if no password policy is available
- [PLAT-10424] Fetch universe list from on-prem node list component if not found in redux store
- [PLAT-10431] Fix supportedReleases initial value
- [PLAT-10436] Ignore backup metadata validation during restore in case backup configuration is empty
- [PLAT-10441] Alert configuration message is shown as successful even when API returns error
- [PLAT-10442] Fix health check email addresses validation to support multiple emails
- [PLAT-10443] Fixing releases to download helm chart using chart path
- [PLAT-10446] Fixing the bug where deviceInfo is not tracked correctly for master nodes
- [PLAT-10451] Add units to Volume size and Provisioned throughput
- [PLAT-10471] GFlag container styles are not applied
- [PLAT-10475] Remove all references to python 2 in YBA
- [PLAT-10502] Add guard rails for YCQL tables while disabling YCQL
- [PLAT-10504] Update regex for matching Azure instance type without local disk
- [PLAT-10534] Features page is crashing
- [PLAT-10560] Incorrect master key rotation when first backup/restore from EAR universe
- [PLAT-10867] [PLAT-10932] Make 'always_backup_tablespaces' runtime flag hidden and false by default
- [PLAT-10868] [PLAT-10548] [PLAT-10646] [PLAT-10695] In UI, make backup tablespaces checkbox unchecked by default
- [PLAT-10961] [PLAT-10630] [Azure] Resume universe failed (Custom exit code exception: Could not find last PowerState for VM)
- [PLAT] Allow cluster role to access all resources under operator.yugabyte.io for operator
- [PLAT] Fix generate_kubeconfig to work against specified namespace
- [PLAT] Fix Kubernetes operator configuration in the helm chart to work with latest runtime configuration changes
Known issues
N/A
v2.19.2.0 - September 11, 2023
Build: 2.19.2.0-b121
Download
New features
- [PLAT-7386] [PLAT-5621] [UI] Implement UI for Server Cert Rotation
- [PLAT-9058] Create Role UI
- [PLAT-9073] New RBAC RoleBinding APIs
Improvements
- [PLAT-6206] Supporting x.y.z+a semver in Helm chart versioning
- [PLAT-6510] Added a log-bundle command to yba-ctl
- [PLAT-7017] [PLAT-7018] API changes to make corecount work on k8s universes.
- [PLAT-7389] Support for LDAPS with openldap server
- [PLAT-7583] Support separate instance types per AZ for read replicas
- [PLAT-7806] Create storybook to expose new atomic components
- [PLAT-7981] Include node-agent logs in support bundle if node-agent is enabled
- [PLAT-8023] [DocDB] Add dockerfile for yugabytedb.
- [PLAT-8037] Add ability to scrape nodes from external K8s clusters
- [PLAT-8076] [xCluster] Use GetReplicationStatus API instead of IsBootstrapRequired
- [PLAT-8134] [UI] Show current active KMS during restore
- [PLAT-8141] Adds a new API for region/az CU operation while deprecating the old ones
- [PLAT-8195] Autofill KMS configuration associated with incremental-backup
- [PLAT-8284] Add API to detect spot interruptions
- [PLAT-8347] [UI] Enable Run Sample Apps during backup or restore
- [PLAT-8470] [PLAT-9415] Add new API to get master information list
- [PLAT-8581] Perform comprehensive GCP storage configuration validation by writing/listing/deleting objects on storage location
- [PLAT-8583] Perform comprehensive S3( static + IAM ) storage configuration validation
- [PLAT-8659] Replicated migration via backup/restore
- [PLAT-8660] Migrating replicated settings to yba-installer
- [PLAT-8677] [PLAT-7008] [PLAT-7108] Update React to v17.x.x and update React-Scripts and its dependencies
- [PLAT-8807] [xCluster] Add a runtime configuration to set the timeout for BootstrapProducer RPC call
- [PLAT-8859] Adding StorageConfig CRD to YBA operator, introducing the backup CRD and reconciler, refactoring backup controller for create and restore to add helper methods that allow calling from non API context, and moving stop backup function to backup helper
- [PLAT-8863] Create a support bundle supportBundleCrd
- [PLAT-8865] Adding support for metrics to Kubernetes operator
- [PLAT-8920] Adding API support for Azure ASG
- [PLAT-9095] Install locales on DB nodes
- [PLAT-9114] Replicated uninstall workflow
- [PLAT-9129] [PLAT-8173] Update PG version and java JRE
- [PLAT-9236] Move systemd alert to bash_profile
- [PLAT-9275] Implementing replicated migration start in yba-installer
- [PLAT-9275] Test script for migrating from replicated
- [PLAT-9301] [UI] Once custom CA trust-store is available in HA, Remove 'Manage Peer Certificates' button if CA store feature is enabled
- [PLAT-9313] Add under-replicated tablets check before stopping node
- [PLAT-9314] Add follower lag check on start node
- [PLAT-9315] Add capability to provision a new boot disk in start processes (in case boot disk is replaced)
- [PLAT-9329] [Backend] Add AppRole auth to Hashicorp vault
- [PLAT-9330] [UI] Add AppRole auth to Hashicorp vault
- [PLAT-9341] OIDC integration with YBA trust store.
- [PLAT-9358] Update under-replicated tablets subtask to be cluster specific(only Primary cluster) and update for db changes
- [PLAT-9385] Propagate
--cluster_uuid gflag
to all masters/tservers from YBA during master/tserver startup - [PLAT-9464] [dr] Add backend support to create/delete/get DR configurations
- [PLAT-9465] Implementing hard reboot for Azure
- [PLAT-9477] Improvements to Performance Advisor UI
- [PLAT-9478] Support az-specific overrides for cgroups
- [PLAT-9514] Support custom mount points for disk usage alert.
- [PLAT-9541] Runtime configuration for custom health checks
- [PLAT-9542] Add cloud specific HTTP health check implementations
- [PLAT-9545] Add per-volume disk usage graph + alert on non-data volumes usage
- [PLAT-9558] Update Imagebundles in case AMI is modified via region
- [PLAT-9585] Allow overriding throughput/iops per AZ
- [PLAT-9591] [LDAP] [UI] Update the "Note" dialogue below for the Service Account section
- [PLAT-9592] Add vnet to instances instead of backend pool
- [PLAT-9597] Add description field for Role entity
- [PLAT-9604] Update boot_script as part of VM Image Upgrade
- [PLAT-9606] Mechanism to retrieve OIDC token when OIDC is enabled and setup
- [PLAT-9607] Verify master configuration operation completed successfully before proceeding to next steps
- [PLAT-9612] Adds the migration for removing stale file_data entry from file_data table
- [PLAT-9619] disable under-replicated tablets checks for software versions < 2.14
- [PLAT-9637] Updating grpc-protobuf
- [PLAT-9640] Updating cryptography package
- [PLAT-9641] Updating the version of akka-actor
- [PLAT-9642] Remove the dependency for net.minidev package
- [PLAT-9643] Update guava version
- [PLAT-9655] [UI] Deprecate insecure login API calls
- [PLAT-9656] Add preference for choosing nodes for YBC backup/restore
- [PLAT-9659] Enhancements to validation around HBA Conf LDAP attributes
- [PLAT-9677] Update default attributes for AWS NLB and Target group
- [PLAT-9690] Backwards compatibility for k8s resource spec API for older API clients
- [PLAT-9691] [PLAT-7168] Custom hostname verification for hosts like s3.amazonaws.com
- [PLAT-9698] Add password policy while configuring DB Apis
- [PLAT-9702] Honour timezone settings from profile page
- [PLAT-9709] [PLAT-3556] Enforce cert verification with secure LDAP with backward compatibility.
- [PLAT-9712] UI improvements for Add UI support for enable/disable DB API
- [PLAT-9716] [PLAT-9718] Allow user to add JWKS key token via modal dialog via
hba_conf
- [PLAT-9717] Process hba_conf file content as part of flag
- [PLAT-9720] Copy certificate from runtime configuration in HA to YBA trust store
- [PLAT-9722] [UI] Modify file upload message on the CA trust store
- [PLAT-9755] Display JWT token in login page
- [PLAT-9770] Disable under-replicated tablets check for upgrades by default
- [PLAT-9771] YBC version bump up
- [PLAT-9773] Expose an API for retrieving jwt_token
- [PLAT-9785] Invalid values on YSQL_HBA_CONF flag
- [PLAT-9787] Changed raw -> command in ansible install-s3cmd.yml playbook
- [PLAT-9788] Increase COMMAND_EXECUTION_TIMEOUT_SEC for node agent
- [PLAT-9789] Removing AMI usage from AWS host info
- [PLAT-9790] Enable multiline GFlag setting for "ysql_ident_csv"
- [PLAT-9800] Implement new query details side panel for live queries
- [PLAT-9808] Add table by table backup support in New Restore Modal
- [PLAT-9817] On-prem instances added using node-agent CLI has zone name appear as UUID on the UI
- [PLAT-9818] make YBC compatible db version runtime configuration
- [PLAT-9819] Must turn off LDAPs enforce cert verification on upgrades if configured
- [PLAT-9829] Add Content-Type headers for special API contents
- [PLAT-9830] Support AMI flow for Azure by allowing to skip Ansible tasks
- [PLAT-9831] Populate plan info for Azure VM creation
- [PLAT-9832] Add optional tag to instance template field
- [PLAT-9834] Change API return type for delete provider
- [PLAT-9856] Telemetry Provider Configuration
- [PLAT-9868] Only allow under-replicated tablets checks with correct db versions
- [PLAT-9869] Make V93 migration compatible with EDB
- [PLAT-9877] Wait for node-agent to come up after the automatic reboot on retry of node tasks
- [PLAT-9890] Exclude rootfs from the disk usage graphs and alerts
- [PLAT-9891] Remove Fetch OIDC token button for superAdmin user
- [PLAT-9903] Update on-prem instance management text for node agent
- [PLAT-9905] Update Runtime configuration to include multiple health check ports and paths
- [PLAT-9922] Minor improvements to existing OIDC JWT mechanism
- [PLAT-9945] Add versioned API token upsert API
- [PLAT-9952] [xCluster] Use
IsBootstrapRequired
API for replication status for old universes - [PLAT-9953] Set useSystemd during creating destroy server subtask
- [PLAT-9981] Enable multiline flag to true by default
- [PLAT-9985] Adding zonefilter to provider creation in Kubernetes operator.
- [PLAT-9986] Set updateSucceeded bit after finishing re-provision task
- [PLAT-10010] Add active universe task code metric
- [PLAT-10018] Pre-Process flags as part of TLS certs configure operation as well
- [PLAT-10021] Preflight check should be added for chronyc
- [PLAT-10059] Run systemctl only for start and stop commands
- [PLAT-10071] Allow userGflag value overrides as part of Round1 TLS cert rotate
- [PLAT-10097] Use node-agent token lifetime as the timeout for RPC calls such that it can be configured from the runtime configuration
Bug fixes
- [New Restore Modal Fixes] [PLAT-9739] Changing Keyspace after table selection takes all keyspace backup
- [PLAT-6180] [PLAT-9777] Show YB DB Version on Universe tile in dashboard and universe list, provider value is not rendered properly in time sync field
- [PLAT-7471] Improve error handling for tasks when task queue is full
- [PLAT-7781] [UI] [SSO] Better Error message when user not found
- [PLAT-8928] Workaround for systemd user ulimits
- [PLAT-9113] Adding missing YBA replicated settings to YBA-installer
- [PLAT-9393] Time is not displayed correctly in YBA metrics page
- [PLAT-9434] Disable rolling upgrade option to toggle TLS in the API
- [PLAT-9447] Specify container name in node_client_utils
- [PLAT-9455] [UI] LDAP role mapping UI issues.
- [PLAT-9480] [UI] Show error message with hyperlink to "CA certificates" page when YBA cannot talk to external servers
- [PLAT-9502] Ensure editing runtime boolean configuration from true to false happens on one click
- [PLAT-9511] Remove the Import Universe function from the YugabyteDB Anywhere
- [PLAT-9577] Disable resume universe when universe is already resumed
- [PLAT-9605] Fix K8 custom resources implementation on UI
- [PLAT-9607] Turn off master operation completion check as it's implemented with wrong RPC call
- [PLAT-9609] [PLAT-9709] Fix migration package name and path
- [PLAT-9620] EditUniverse retries after failures can cause unpredictable behavior.
- [PLAT-9630] Return 409 Conflict in case provider with same exists
- [PLAT-9636] Update protobuf to fix cves
- [PLAT-9649] [xCluster] Fix sync xcluster on remove table from yb-admin
- [PLAT-9664] Add timeout for devops operations to make sure tasks does not run infinitely.
- [PLAT-9707] Properly redact API responses VS logs
- [PLAT-9723] Show error about CA certificates upload on LDAP TLS connect error
- [PLAT-9733] Don't fail scheduled full/incremental backups if one/few tables are deleted from the selected table list
- [PLAT-9733] Incremental Backup is not allowed with selective restored tabled in same keyspace
- [PLAT-9738] Azure destroy instance bug
- [PLAT-9752] Fix path and data type for GCP operations runtime configuration
- [PLAT-9763] Fix Alma 9 ARM AMI upgrade "TypeError: in method 'lgetfilecon_raw'" issue
- [PLAT-9768] ybactl install failed on upgrade
- [PLAT-9781] Universe API returns wrong EAR disabled state
- [PLAT-9782] S3 configuration creation object list fix
- [PLAT-9783] Fix Azure orphan NIC deletion
- [PLAT-9796] Display err msg and link to CA cert store when LDAP connection fails due to CA cert Error.
- [PLAT-9823] Handle JWT token expiration scenario
- [PLAT-9824] Remove auth parameter validation for cloud
- [PLAT-9839] Remove non-null check for "namespace_name" field of success marker file
- [PLAT-9843] Duplication of GFlag import statement causes runtime error
- [PLAT-9889] Newer table UUID is passed during Incremental backup
- [PLAT-9893] On disabling EAR, the kmsConfigUUID is not set
- [PLAT-9894] [K8] Backups are not deleted automatically after deleting the universe
- [PLAT-9902] Remove leaked passwords check which is identified as security vulnerability
- [PLAT-9904] Node agent token is exposed in the log on error
- [PLAT-9906] Master data folders are not cleaned up when it is added back in shell mode
- [PLAT-9908] Metric graphs not getting populated in latest master- 2.19.2.0-b7
- [PLAT-9910] [SLES] SLES On-prem universe creation fails on pre-flight checks
- [PLAT-9911] Fix backup size field of success marker
- [PLAT-9914] Fixing non root install
- [PLAT-9930] YBA upgrade is failing with AddRuntimeCertsToCAStore" failed! Changes successfully rolled back.
- [PLAT-9939] Fix failing UT on master
- [PLAT-9941] KMS configuration is not selected by default during restore
- [PLAT-9957] Non-restart flag upgrade task doesn't actually change flags in memory
- [PLAT-9958] [UI] Edit Universe failing after deleting read replica
- [PLAT-9963] Handle null health checks in GCP while managing load balancers
- [PLAT-9979] map attribute should enclose its values in quotes automatically in ysql_hba_conf flag
- [PLAT-10008] Deleting provider sets the provider state in Error
- [PLAT-10014] YBC version upgrade for CA cert bundle fix
- [PLAT-10016] Pass masked k8s pull secret values when not editing pull secret
- [PLAT-10017] Missing flag values on the edit page for Multi Line (ysql_hba, ysql_ident) flags.
- [PLAT-10026] Validation issues for custom K8 resources when creating universe
- [PLAT-10027] Azure object listing fix for pre-backup validation
- [PLAT-10029] Adding Specific flags support to work with k8s flags upgrade tasks.
- [PLAT-10029] Fo K8s universes that are still created with specific flags, which is not yet supported in k8s
- [PLAT-10035] Issue while checking the existing flag values with adding new flag
- [PLAT-10036] [Master] Enable enableNewRestoreModal feature flag by default for selective restore
- [PLAT-10058] Fix Read replica creation with K8sResource Spec options.
- [PLAT-10063] Add a runtime flags to skip auto-flags promotion and YSQL upgrade
- [PLAT-10069] Fix Read replica creation and Edit universe with K8sResource Spec options.
- [PLAT-10090] Keywords like JWT and LDAP disappear when they are typed
- [PLAT-10093] Do not apply metric specific filter overrides to other metrics
- [PLAT-10109] Support Bundle Creation is failing on K8 universes
- [PLAT-10190] [DR] Fix delete PITR configuration conflict with txn xCluster configurations
- [PLAT-10115] Image Bundle migration fix when primary & RR clusters are configured with different providers
- [PLAT-10211] Fixing Permissions for YBA upgrade to work as expected on k8s with files created with older permissions
- [platform] Fix V281 migration
Known issues
N/A
v2.19.0.0 - June 20, 2023
Build: 2.19.0.0-b190
Download
New features
- [PLAT-7688] Add support for provider status on YBA UI
- [PLAT-7121] HA implementation for YBA installer
- [PLAT-7349] Add GUI support for S3 backup proxy settings
- [PLAT-7685] [PLAT-7694] [PLAT-8248] Add support for editing unused Kubernetes providers
- [PLAT-7971] Package installing YBDB with YBA installer
- [PLAT-8177] [UI] Add webhook feature for Custom alert notification template
- [PLAT-8692] [UI] Enable custom template editing for alert channels by default
- [PLAT-8725] Add supported region and zone options to the new provider UI
Improvements
- [PLAT-4474] Allow yb-tserver to manage its own cgroups
- [PLAT-4624] Add GFLAGS for raft interval in case of multi-region deployment
- [PLAT-5435] Upgrade version check uses metadata.json
- [PLAT-6348] Restoring yugabundle backup to yba-installer
- [PLAT-6610] Update gflags for tservers when switching between dedicated and normal modes
- [PLAT-6737] [xCluster] Add retry logic to IsBootstrapRequired and BootstrapProducer RPCs
- [PLAT-6940] Add Validation for NFS Based Backups
- [PLAT-7074] Add Region active/deleted state and AZ active/deleted State
- [PLAT-7269] update yb-client build.sbt version from -test
- [PLAT-7284] Added Snapshot view for migration V231
- [PLAT-7336] Chart changes for non-rolling support
- [PLAT-7336] K8s non-rolling Gflag upgrade
- [PLAT-7363] Adds Image Bundle Support in YBA
- [PLAT-7425] [SSO] Ability to supply provider metadata when discovery URL is not accessible
- [PLAT-7425] [SSO] Unit test for new runtime configuration for OIDC
- [PLAT-7487] Use postgres 14.6 for YBA installer
- [PLAT-7493] Add auto flags check before configuring xCluster on a universe.
- [PLAT-7494] Promote auto flags only when all xCluster universes are upgraded.
- [PLAT-7554] [UI] Add authentication configuration fields for WebHook channel
- [PLAT-7607] Support YCQL table by table backup for V2 APIs
- [PLAT-7620] Kubernetes Operator initial checkin
- [PLAT-7631] Introduces runtime flag for allowing edit for used providers
- [PLAT-7687] Track provider state while creating/editing provider which should indicate if the provider is usable
- [PLAT-7694] Use regions from host k8s configuration
- [PLAT-7743] Catch app init exceptions and log
- [PLAT-7795] Changes to allow building YBA with JDK17
- [PLAT-7837] Adds AZ name/code validation for on-premises provider
- [PLAT-7934] Add metrics to detect the change in raft leaders on a node
- [PLAT-8003] Add auto flags checks during GFlagsUpgrade
- [PLAT-8042] [XCluster] [k8s] Create namespaces for univ2 in univ1's k8s cluster during xCluster setup, vice versa when MCS is enabled
- [PLAT-8122] Enable node-agent phase 2 for all new providers by default for non YBM
- [PLAT-8123] Install YBC software on on-prem manual provisioned Systemd universes
- [PLAT-8128] Install YBC for on-prem manually provisioned cron based universe during software upgrade software upgrade
- [PLAT-8131] Add a client side check for YB software version on the xCluster txn atomicity option.
- [PLAT-8132] Change Task name to be more informative for EAR Rotate
- [PLAT-8136] Add runtime flags to make the minimum incr backup schedule frequency configurable
- [PLAT-8164] Make postgres logs regex pattern a runtime configuration
- [PLAT-8179] Redact azure client secrets in audit log
- [PLAT-8207] Allow editing disk IOPS and throughput via resize node API
- [PLAT-8231] Add backup/restore for YBDB
- [PLAT-8246] Improve Incremental backup resource consumption
- [PLAT-8257] added preflight check for pgcrypto in postgres
- [PLAT-8260] Make changes in node-agent to run any procedural task to support preflight check and future task
- [PLAT-8296] Set yb.xcluster.transactional.enabled as an INTERNAL runtime configuration
- [PLAT-8297] Change the console title of YBA replicated portals
- [PLAT-8316] Add placeholder text and validation for zone code
- [PLAT-8317] Compare the entire cloudInfo as part of edit instead of env vars
- [PLAT-8319] [UI] Support for table by table backup
- [PLAT-8336] [PLAT-8468] [PLAT-8546] [PLAT-8832] Bump up YBC version
- [PLAT-8339] Added securityContext=false in the
openshift.values.yaml
- [PLAT-8343] Run field validation when setting region in YBA provider form UI
- [PLAT-8344] Add Provider Name Check Validation for k8s Provider
- [PLAT-8353] Change the usage for skipKeyPairValidate flag to accessKey property.
- [PLAT-8354] Enable the runtime configuration to true for dedicated master
- [PLAT-8396] Add MCS related resources to RBAC files
- [PLAT-8397] Node stop/removal must ensure the number of YB-TServers does not drop below quorum for dedicated masters
- [PLAT-8398] Improve usage for list all alerts API
- [PLAT-8404] [MKR] Enable MKR feature flag
- [PLAT-8406] Change runtime configuration for boolean fields from dropdown to toggle
- [PLAT-8415] [PLAT-8249] Allow access key edit as part of provider edit
- [PLAT-8419] Use bulk fetch instead of SQL query for every row of task info in commissioner class
- [PLAT-8421] Making CreateKubernetesUniverse support abort and retry operations, making DestroyKubernetesUniverse retryable
- [PLAT-8429] Add pagination to provider list and region list
- [PLAT-8441] Removed yq and used YAML package in ocp.py
- [PLAT-8449] [Helm Overrides] [UI] Show error when validation API fails
- [PLAT-8453] Add loading spinners for on-premises and k8s forms
- [PLAT-8456] Expose metrics endpoint in node-agent for Prometheus to scrape
- [PLAT-8461] Filter by streamId when fetching per-table replication lag
- [PLAT-8478] [PLAT-8491] Sort recommendation by table name and change label for last scan date
- [PLAT-8486] Batch the need_bootstrap requests
- [PLAT-8487] Allow any 2XX response in WebHook alert channel
- [PLAT-8496] Use provider configuration from props to get region/access key info
- [PLAT-8504] Enable PA scan for 'postgres' DB + disable scans from the Follower YBA instance
- [PLAT-8514] Helm install with user provided key and certificate
- [PLAT-8537] Turn on Performance Advisor runtime configuration to true by default
- [PLAT-8542] Support access key edit on the UI
- [PLAT-8543] [UI] [YBC] Use throttle values( min/max/default/current ) from backend to populate throttle parameters GUI
- [PLAT-8545] Continuation of redact token for node agent
- [PLAT-8548] Add snapshot model for V235 java migration
- [PLAT-8550] Enable per-file java linter + migrate to latest sbt-java-formatter
- [PLAT-8554] Use Custom AMIs if specified in provider for image bundle generation
- [PLAT-8559] Sync certs to DB as part of upload cert flow
- [PLAT-8587] Improve yba-installer logging during install workflow
- [PLAT-8627] Determine node-agent ansible offloadability based on the node-agent installation
- [PLAT-8630] Add Postgres<->YBDB upgrade support in yba-installer
- [PLAT-8639] [Custom Templates] Add escape from edit variable on template variables
- [PLAT-8644] Merge Access Key Content as part of provider edit
- [PLAT-8670] Turn on AWS provider validation
- [PLAT-8681] Incorporate increasing read replica RF in the YBA UI
- [PLAT-8683] Send kubeConfig name or filepath in provider payload
- [PLAT-8699] [PLAT-8750] Delete certs from DB as well as part of cleanup
- [PLAT-8703] Export per-node provisioned IOPS, provisioned throughput metrics
- [PLAT-8722] Read and parse cloudtype_metadata file for only the cloud type passed to ybcloud.py
- [PLAT-8728] Explicit upgrade for node agent version before YBA -> node agent grpc call
- [PLAT-8731] Helm chart portion - Scrape node-agent metrics for alert generation
- [PLAT-8732] Set EBS volume flag for Delete on terminate to YES
- [PLAT-8799] Make node agent list and get API available in swagger and enhance the response for UI
- [PLAT-8833] Upgrade pip only during venv build time.
- [PLAT-8880] [PLAT-8770] Make node-agent work on custom ports + configurable token lifetime
- [PLAT-8296] Put txn atomicity checkbox behind a runtime configuration feature flag
Bug fixes
- [PLAT-4247] Modify preflight subtask on platform to use the node agent
- [PLAT-6348] Correcting filepaths for yba-installer migration.
- [PLAT-7269] Added a retry for ModifyMasterClusterConfig on configuration version mismatch
- [PLAT-7289] Fix the sliding of incremental backup schedule tasks on each run
- [PLAT-7462] Block Universe upgrade/creation if the DB version selected is higher than the current
- [PLAT-7474] Disabled spot instance toggle in edit universe
- [PLAT-7567] correctly scrape platform metrics for https
- [PLAT-7587] Upgrading azcopy in master for CVE fixes
- [PLAT-7729] Fixing go and java dependencies, including on node-agent and yba-installer, and updating version of snakeyaml to 2.0 to fix CVEs, also making required code changes to make code compile
- [PLAT-7765] [PLAT-8234] [PLAT-8235] Universe creation fails with YBC if a zone is in a different K8s cluster. Fix master gflag upgrade. Restart YBC in the case of a crash.
- [PLAT-7765] Health checks failing for YBC on k8s multi-cluster deployments. Modify the dns1 format
- [PLAT-7960] retry AWS volume mod + print failure status message
- [PLAT-8013] Fix YCQL auth enabled health check, YCQL health check fail for OpenShift environment
- [PLAT-8029] yba-installer creates directories with correct ownership.
- [PLAT-8034] [Master] KMS configuration is not displayed in Backup Details Page
- [PLAT-8043] Handle VM states appropriately in the wait_for_ssh_ports method
- [PLAT-8045] Add extra text to indicate peer cert requirement for HTTPS HA setup
- [PLAT-8063] [PLAT-8066] Helm upgrade failed with server.pem
- [PLAT-8075] Change the path of ysqlsh and ycqlsh in Connect dialog
- [PLAT-8094] add data-test-id to custom email editor
- [PLAT-8116] MKR | Rotation tasks logs should also have KMS configuration name
- [PLAT-8121] [PLAT-8356] [PLAT-8391] [PLAT-8432] fix : UI allows entering invalid characters in universe name, New UI should not ignore nodesResizeAvailable, User should be able to add more AZs than RF in UI when enableGeoPartitioning is turned on
- [PLAT-8127] Stop YBC process during deletion of Universe for on-premises universes
- [PLAT-8190] Back to back disk resize will render the universe unusable
- [PLAT-8193] k8s Provider edit UTs fix
- [PLAT-8200] Disable radio buttons when provider is in use
- [PLAT-8210] Periodic SetUniverseKey sets the wrong universe key ID after MKR
- [PLAT-8212] Fix db_seed and internal user creation flow
- [PLAT-8220] [Incremental backups] UI not sending correct request to backend for YCQL table level incremental backups
- [PLAT-8223] [PLAT-8372] Ensure volume size is based on provider configuration and search values persists between editing runtime configuration values
- [PLAT-8236] Fix universe cost calculation for universe create/edit scenario
- [PLAT-8238] Return default value for runtime keys
- [PLAT-8269] Fix backup expiry time
- [PLAT-8273] [PLAT-8278] Handle undefined provider values and fix edit Azure provider form reset
- [PLAT-8277] Fix /regions API slowness
- [PLAT-8282] [PLAT-8211] [PITR] Issue with recovery using date option
- [PLAT-8291] Resize read replica would not get correct cgroups
- [PLAT-8298] Fix Incorrect total storage shown in Universe Overview page
- [PLAT-8305] [PLAT-8268] [PLAT-8253] [PLAT-8345]: Fix use cases where manual Re-scan doesn't give latest recommendations
- [PLAT-8306] Universe locked at parent task is trying to lock it again at subtask
- [PLAT-8320] Fixed the regex to handle the duplicate CPU metrics
- [PLAT-8321] Fixed multiple performance advisor issues, found during testing
- [PLAT-8349] Edit volume size is causing pods to be deleted in multi-az
- [PLAT-8359] [2.19.0.0-b145] Current state of a stopped node is "Unreachable"
- [PLAT-8363] Fix DB migration version, put alert rule strings in double quotes
- [PLAT-8366] [PLAT-8387] Scheduled backup configurations are not displayed in UI.
- [PLAT-8369] Software upgrade on a YBC universe causing controller container to get removed
- [PLAT-8373] Remove pre-populate zone k8s configuration logic
- [PLAT-8377] [Platform] Can't see platform logs on the yugabundle portal
- [PLAT-8378] Remove YB_BACKUP_SCRIPT condition from YSQL database overwrite check
- [PLAT-8382] Fix retry API to return the submitted task UUID.
- [PLAT-8384] Fix YCQL health check
- [PLAT-8386] Fixed CPU metrics for YBA charts for OCP
- [PLAT-8393] Fixed the PGSQL Data path for YBA OCP-certified chart
- [PLAT-8394] Bug in "YCQL subset of tables" backup
- [PLAT-8400] [Custom Email] Variables are not clickable on the default template
- [PLAT-8407] [PLAT-8408] Fix to ensure node name is seen on the graph and resolved recommendation does not get reset when filtering by DB or Suggestion
- [PLAT-8415] Skip Access Key edit for k8s providers
- [PLAT-8417] Do not return true from updateKubeConfig method when trying to set pull secret for k8s provider
- [PLAT-8438] Timezone is not in 24 hour format
- [PLAT-8439] [Custom Templates] Preview doesn't show actual message in case of most of the alert policies
- [PLAT-8439] Fix test alert generation in case no universes defined
- [PLAT-8439] Properly validate WebHook template for valid JSON
- [PLAT-8450] Fix performance advisor scan during backup
- [PLAT-8451] Show failure reason on UI if performance advisor run has failed
- [PLAT-8459] Remove semi-colon under backup list
- [PLAT-8469] Run performance advisor script on TServer nodes only
- [PLAT-8489] Fix saving default JSON template
- [PLAT-8492] Fix the merge for configuration properties at AZ level
- [PLAT-8498] Incorrect throttle parameter values for K8s pods/dedicated nodes
- [PLAT-8511] A node on add must get removed from master's blacklist
- [PLAT-8515] Fetch only the cluster nodes as part of VM image upgrade
- [PLAT-8516] Backups not getting cleared after retention is complete
- [PLAT-8517] Do not disable provider fields when form is validating
- [PLAT-8518] Update the Redux store when creating or deleting providers
- [PLAT-8523] Set kubeConfig as "" in case no configuration provided at any level
- [PLAT-8530] Use newer PA version with k8s related fixes
- [PLAT-8532] Fix: Universe name validation missing for GCP and k8s universe
- [PLAT-8535] Fix Auto flags promotion during SoftwareUpgrade
- [PLAT-8539] tserver is down for more than a minute in rolling restart for flags update
- [PLAT-8549] [PLAT-8592] [MKR] Bug fixes and improvements
- [PLAT-8553] [Master] [2.19.0.0-b81] Failed to edit read replica
- [PLAT-8570] Don't provide table name list to yb_backup during YCQL restore
- [PLAT-8571] [PLAT-8584] Auto refresh should retain value when switching between tabs
- [PLAT-8575] Escape $ in YSQL password for k8s universe
- [PLAT-8576] Change cluster retrieval for a node during Install and upgrade YBC tasks.
- [PLAT-8582] Perform comprehensive Azure storage configuration validation by writing/listing/deleting
- [PLAT-8595] Fix PLAT-8595 snakeyaml does not allow untrusted tags
- [PLAT-8614] Update provider field labels and data-testids
- [PLAT-8623] Run CloudSetup as part of edit in case bootstrap failed on create
- [PLAT-8624] Metrics not populated after yugabundle restore
- [PLAT-8629] Omit empty fields from provider payload, relax requirement for AMI ID when adding regions to existing provider
- [PLAT-8636] [K8s] Schedule Backups are failing with UniverseDefinitionTaskParams cannot be cast to InstallYbcSoftwareOnK8s
- [PLAT-8638] Handle DB names retrieval failure properly.
- [PLAT-8646] [Provider] Set READY state when user creates onPrem provider using old API as a workaround
- [PLAT-8649] Ensure rejected recommendations is shown as part of Performance recommendations
- [PLAT-8652] Add customer in the condition of query to fetch universe definition fields while listing tasks
- [PLAT-8655] Avoid acquiring provider lock on az/region edit as part of provider edit
- [PLAT-8691] [YBC] Adding a decommissioned node fails on fault injection - pinging YBC would fail
- [PLAT-8693] [Custom Email] UI goes blank on clearing the text from subject input
- [PLAT-8695] Move backup intermediate state save from task_info to Backup object
- [PLAT-8726] Fix checksum mismatch causing whitespace changes in flyway migrations
- [PLAT-8734] Fixing CVEs for 2.18.1
- [PLAT-8742] [PLAT-8743] Fix recommendation content being same in header and body and change deeplink of learnMore tutorials to YBA rather than YBM
- [PLAT-8744] Fix Hot Shard recommendation info + threshold names
- [PLAT-8761] Typo in Java proxy property- nonProxyHosts
- [PLAT-8773] Fix regression where pathStyleAccess is not respected by backend
- [PLAT-8779] Backup list response sends wrong "allTables" parameter value
- [PLAT-8787] Delete the remote access key on AWS region deletion
- [PLAT-8885] Use StringUtils.isBlank instead of null check for taskId in RestoreBackupYbc
- [PLAT-8904] Tabs should be displayed based on nodeType dropdown
- [PLAT-8994] k8s Universe creation failed with auth enabled if TLS with only client to node
- [PLAT-9182] S3 getBucketRegion for YBC backup/restore does not respect cert disabling.
- [PLAT-9249] yba-installer upgrade workflow fails
- [CLOUDGA-11517] reboot if SSH is down after resume
- [CLOUDGA-13465] remove uses of FileData.getAll
Known issues
N/A