https://docs.vydon.io/changelog 2025-03-27T00:00:00.000Z https://github.com/jpmonette/feed Vydon Blog https://docs.vydon.io/img/logo_light_mode.png https://docs.vydon.io/changelog/pii-detection-batch-job 2025-03-27T00:00:00.000Z

Adds PII batch detection job to UI

Fix remove invalid column button

Optimized PII detection sql queries for faster performance

Add in support for PII job report in the Runs page

Add support for incremental scans

Add support for cloning PII detection jobs

Add support for downloading PII detection report

Add support for auto increment generator

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/slack-integration 2025-03-13T00:00:00.000Z

Adds support for a Slack integration for web hooks

Adds PII batch detection job

Update account hooks lifecycle events to PII detect jobs

Allow users to remove jobs if the temporal schedule does not exist

Add support for importing and exporting mappings in GRPC format

Handle converting json null to sql null correctly

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/connection-security 2025-02-27T00:00:00.000Z

Fix bug where we were converting json null to sql null incorrectly

Fix issue with on conflict

Fix MSSQL trigger sql generation error

Fix an issue with the phone number transformer in the validation

Add in webhooks UI

Add in granular support for viewing connection credentials

Add in support for making job hook names unique system wide

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/webhooks 2025-02-13T00:00:00.000Z

Expose column removal strategy in Terraform

Expose virtual foreign keys in Terraform

Expose subsetbyforeignkeyconstraints in Terraform

Expose advanced connection options in Terraform

Add support for webhooks

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/upgrade-python-sdk 2025-01-30T00:00:00.000Z

Upgrade Python SDK to be easier to use and fix imports

Fix MYSQL index statements when using non-column expressions

Optimize GenerateFullName transformer for speed

Upgrade Generate Job to apply passthrough on apply default transformers

Optimize SQL disconnections and busy signals during sync

Upgrade Vydon Cloud Logs UI to include more information like activity, table, schema

Show init schema run context on Runs page

Support creating Postgres extensions within the init schema

Add new error codes to job mappings validator response

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/anon-api-synthetic-data 2025-01-16T00:00:00.000Z

Add support for column removal strategy to handle schema changes in day 2 operations

Add support for on conflict handling in Postgres and Mysql

Enhance the python SDK entry point to be easier to use

Add support for using Vydon Transformers in the Anonymization API with replace

Optimized the Subset table to be way more performant

Add support for sourcing the connection url from an environment variable

Fix the Clone Transformer form

Add support for creating DB schema in the init schema options

Added ability to bulk apply subsets

Optimized the GenerateCity transformer to be way faster

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/v5 2025-01-02T00:00:00.000Z

Fixed a bug that was causing generate javascript code to not be persisted across modal open/closes

Adds support for bit, varbit and datetime types

Removed all @deprecated fields in the API

Removed all unused or deprecated methods.

Introduced a new Vydon data structured for reading/writing data to s3

Updated the Typescript SDK to use the Connection V2 api

Object storage/metrics/logs have been moved to the Enterprise license for self-hosted Vydon

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/rbac 2024-12-19T00:00:00.000Z

Fixed a bug that was causing generate javascript code to not be persisted across modal open/closes

Added support for Job Hooks to Terraform

Added support for RBAC in Vydon

Fixed a bug that was causing the worker to silently fail due to a Redis configuration

Added support for uploading client TLS certificates to Mysql

Added support for uploading client TLS certificates to MS SQL

Updated Subsetting logic to account for nullable foreign keys

Updated Subsetting page to use a modal instead of inline SQL filters

Exposed a button that allows users to see what SQL queries we're running in the Runs page

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/job-hooks 2024-12-05T00:00:00.000Z

Added support for pre job hooks

Added support for post job hooks

Re-factored DB connections to be much more stable and efficient

Added S3 end-to-end tests for mysql and postgres

Updated the Job Mapping table to fix layout overflow issues and styling

Fixed a bug that was the post table sync activity to fail when tables were case sensitive

Add multi-language support to Anonymize PII transformer

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/eu-infrastructure 2024-11-21T00:00:00.000Z

Added support for EU infrastructure

Added support for init schema in SQL Server

Updated CLI to have better support for API keys and not always require them

Updated Worker to support fallback properties for batch properties

Updated Job Mappings Table to be way more optimized and smoother

Added a loading state to the Apply Default Transformers

Fixed a bug that was causing SQL Server to not truncate tables correctly

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/column-strategy 2024-11-07T00:00:00.000Z

Added support for new column strategy to auto-map new columns

Added support for an IP Address Transformer

Added support for batching config options in the CLI

Added support for batching config options in the App

Added support for configuring max in flight for sql insert/update

Added support for importing and exporting mappings from the Jobs page

Added support for a business name transformer

Added a countdown component to trials to show time remaining

Updated sql to json datatypes in AWS output when syncing

Fixed a bug that was causing nil pointer errors when there were empty tables and we were syncing S3 -> database

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/anonymization-api 2024-10-24T00:00:00.000Z

Added support for free form text anonymization as an API

Added support for free form text anonymization as a transformer through the job sync

Added support for configuring the entities in the anonymization API

Added support for allow/deny lists in the API

Added support for configuring the S3 connection parameters in the CLI

Added support for a Python SDK

Added new SDK docs with more examples and code snippets

Added support for the CLI to use shared connection pools

Added support for default values for Transformers

Added support for more run details in an expanded view

Fixed a bug that was causing the CLI sync from S3 -> Mysql to break when a table is empty

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/cli-sync 2024-10-10T00:00:00.000Z

Update CLI to support syncing from S3

Support ability to convert a personal account to a paid team account

Support inserting JSONB types

Init Data Anonymization API Endpoint

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/revamped-bulk-transformer-support 2024-09-26T00:00:00.000Z

Added in-app documentation links

Added support for real time connection validation in the Generate job

Add support for pay-as-you-go plan

Update Transformer Sheet to be a modal

Update Bulk Transformer logic to support Use Column Default

Add support for Postgres UUID Array types

Resolve bug with DEFAULT values in Generated Identity columns

Support Passthrough for Identity columns

Add custom transformers to the Bulk Transformers

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/apply-default-transformers 2024-09-12T00:00:00.000Z

Add support for duplicating NoSQL Mappings inline

Optimized Subset Query builder to be much faster and more efficient

Updated NoSQL Mapping table to catch duplicate mappings

Add support for skipping foreign key errors

Add support for Postgres generated always column types to passthrough

Support special characters in schema/table names

Expose SQL statements in Runs page

Extend the Job/Transformer/Connection/API key name limit from 30 to 100 characters

Add support for applying default transformers to the Mapping table with one click

Surface Generated column badges in the Job Mapping table

Support SQL Server Truncate options

Add support for Team accounts in OSS Vydon

Add real time validation for connections in the Connect page

Add a Country Code Transformer

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/sql-server-support 2024-08-29T00:00:00.000Z

Add support updating Mongo DB mappings in line

Add support for Microsoft SQL Server

Add support for MSSQL tunneling

Add support for special characters in mysql connection

Add new documentation for how to set up logging

Add new documentation for MongoDB

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/dynamodb-upgrades 2024-08-15T00:00:00.000Z

Update default GPT models in Vydon

Added initial support for SQL Server

Added support for ConsistentReads in DynamoDB

Support seeds for all transformers for deterministic outputs

Add support for DynamoDB key deep linking

Add support for configuring app resources in helm chart

Fix benthos issue from main lib that was causing type loss in DynamoDB

Add subsetting to DynamoDB

Add support to DynamoDB for default transformations of unmapped types

Fix a bug in Mysql that occurred when a column was named with a reserved keyword

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/dynamodb 2024-08-01T00:00:00.000Z

First class support for integrating with DynamoDB

Fixed a bug that was causing some Redis values to not get cleaned up

Update generate_state transformer to return full state names as an option

Add role permissions to MYSQL connection

Improve mysql init schema options to resolve circular dependencies

Add auto-complete to custom javascript transformers

Update Connect page to ensure that users only select valid destinations based on the source connection

Support subsetting within DynamoDB

Update integration tests to parallelize

Fix a rare data race issue that occurs in Benthos

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/vydon-js-modules 2024-07-18T00:00:00.000Z

Support for accessing transformers within custom javascript transformers

Fixed a bug within the init schema option that occurred when a sequence already existed

Updated Mysql connection to be more flexible and handle URL parsing

Updated docs to include auto-generated docs for transformers in custom transformers

]]> Evis Drenova https://twitter.com/evisdrenova https://docs.vydon.io/changelog/job-cloning 2024-07-04T00:00:00.000Z

Added support for MongoDb TLS certificates for TLS

Added support for MongoDb connection pooling

Added support for the ability to clone a job

Added support for Google Cloud Storage as a destination connection

Added support for publishing to Artifact hub

Added a batch size config option to the OpenAI generator

Added support for being able to use generators and transformers inside of the javascript transformers

Better handling of OpenAI generator token limits

Added support for configuring sidecars in helm charts

]]> Evis Drenova https://twitter.com/evisdrenova