Beta Migration Guide

Summary of changes:

• RAW and DECODED schemas are no longed necessary. All tables are available in a new database schema called MARKETPLACE.

• Business data such as Transfers and Tokens are available in the same database and schema.

• Raw and decoded tables have been merges into single tables for all entities. A "decoded" column is present to flag the status of the decoding process.

• Columns have been renamed, removed or added across all tables. Specific details and mapping to the new column are provided for each table to facilitate changing queries.

Changes in the data model

Once you have moved the new database you can follow the details below to update your queries. Make sure that you also update the name of the database and the schema. Need help? Reach out to our team.

Blocks

New columns

Column	Data Type	Layer	Nullable	Definition
difficulty	bigint	RAW	YES	Amount of effort required to mine a new block, set by the network - used in PoW consensus, not used for PoS consensus (after the Shanghai hard fork).
excess_blob_gas	integer	RAW	NO	Running total of excess data gas consumed on chain since EIP-4844 was activated. If the total amount of data gas is below the target, excess_blob_gas is capped at zero.
decoded	boolean	TECH	NO	Technical field. Defines processing status of a block by the decoding ETL process.
size	integer	RAW	NO	Size of the block in bytes.
uncles	JSON	RAW	NO	Array of uncles' hashes. Empty array if block has no uncles.
withdrawals	JSON	RAW	YES	Array of block header Ether withdrawals. For every withdrawal : * address - address of the withdrawal receiver; * amount - hexadecimal representation of the withdrawal amount (in wei) * index - withdrawal index * validator_index;

Existing columns

Schema - EDW BETA	Column - EDW BETA	Column - EDW	Changes & Comments
RAW	block	block_number	Renamed
RAW	block_hash	block_hash
RAW	timestamp	block_timestamp	Renamed
RAW	canonical	-	Removed
RAW	parent_hash	-	Removed
RAW	tx_count	tx_count
RAW	miner	miner
RAW	gas_limit	gas_limit
RAW	gas_used	gas_used
RAW	base_fee_per_gas	base_fee_per_gas
RAW	extra_data	-	Removed
DECODED	block	block_number	Renamed
DECODED	block_hash	block_hash
DECODED	timestamp	block_timestamp	Renamed
DECODED	canonical	-	Removed
DECODED	parent_hash	-	Removed
DECODED	tx_count	tx_count
DECODED	miner	miner
DECODED	gas_limit	gas_limit
DECODED	gas_used	gas_used
DECODED	base_fee_per_gas	base_fee_per_gas
DECODED	extra_data	-	Removed

Calls

New Columns

Column	Data Type	Layer	Nullable	Definition
arguments	JSON	DECODED	YES	List of function arguments as key:value pairs as decoded by Token Flow processes (ABI or inferred from similar functions). Contains call_data if decoding was unsuccessful.
call_depth	mediumint	TECH	NO	Depth of the call in the transaction execution tree, incremental, starting at 0 for top level calls (call_path='0_2_1' depth= 3 means three level down in the execution tree).
from_name	text	DECODED	YES	Name of the call sender (calling address) as decoded by Token Flow processes (ABI or inferred from similar functions). Contains calling address if not found.
function_name	text	DECODED	YES	Name of the function, decoded by Token Flow processes (ABI or inferred from similar functions). Contains function_signature if decoding was unsuccessful.
function_signature	char(10)	RAW	YES	Binary signature of the called function. 0x in case of pure Ether transfers.
outputs	JSON	DECODED	YES	List of function outputs as key:value pairs, as decoded by Token Flow processes (ABI or inferred from similar functions). Key is the output name and value is the decoded value. Contains a single output_data argument if decoding was unsuccessful.
to_name	text	DECODED	YES	Name of the call receiver (called address) as decoded by Token Flow processes (ABI or inferred from similar functions). Contains called address if decoding was unsuccessful.

Existing Columns

Schema - EDW BETA	Column - EDW BETA	Column - EDW	Changes & Comments
RAW	block	block_number	Renamed
RAW	timestamp	block_timestamp	Renamed
RAW	call_id	call_id
RAW	tx_hash	tx_hash
RAW	call_path	call_path
RAW	call_type	call_type
RAW	from_address	from_address
RAW	to_address	to_address
RAW	call_value	call_value
RAW	call_data	-	Removed
RAW	return_value	-	Removed
RAW	created_address	created_address
RAW	created_code	-
RAW	storage_address	-
RAW	call_gas	gas_limit	Renamed
RAW	gas_used	gas_used
RAW	gas_refund	gas_refund
RAW	exception_error	exception_error
RAW	revert_reason	revert_reason
RAW	success	executed	Renamed
RAW	status	reverted	Renamed / Change in business logic : reverted (true), persistent (false)
RAW	order_index	order_index
DECODED	block	block_number	Renamed
DECODED	timestamp	block_timestamp	Renamed
DECODED	call_id	call_id
DECODED	tx_hash	tx_hash
DECODED	call_path	call_path
DECODED	call_type	call_type
DECODED	from_address	from_address
DECODED	to_address	to_address
DECODED	call_value	call_value
DECODED	created_address	created_address
DECODED	created_code	-	Removed
DECODED	storage_address	-	Removed
DECODED	call_gass	gas_limit	Renamed
DECODED	gas_used	gas_used
DECODED	gas_refund	gas_refund
DECODED	exception_error	exception_error
DECODED	revert_reason	revert_reason
DECODED	success	executed	Renamed
DECODED	status	successful	Renamed / Change in business logic : reverted (true), persistent (false)
DECODED	decoding_status	decoded	Renamed
DECODED	from_name	from_name
DECODED	to_name	to_name
DECODED	function_singature	function_signature
DECODED	function_name	function_name
DECODED	arguments	arguments
DECODED	raw_arguments	-	Removed
DECODED	outputs	outputs
DECODED	raw_outputs	-	Removed

Events

New Columns

Column	Data Type	Layer	Nullable	Definition
abi_inferred	boolean	TECH	YES	Flags whether the function semantics used for decoding was taken from the called contract's ABI (False) or it was inferred from other contracts (True).
event_id	text	TECH	NO	Technical field. Identifier of the event, constructed by concatenating block_id and order_index, separated by underscores.

Existing Columns

Schema - EDW BETA	Column - EDW BETA	Column - EDW	Changes & Comments
RAW	block	block_number	Renamed
RAW	timestamp	block_timestamp	Renamed
RAW	tx_hash	tx_hash
RAW	log_index	log_index
RAW	call_id	call_id
RAW	contract	contract
RAW	log_data	-	Removed
RAW	topic0	event_signature	Renamed
RAW	topic1	-	Removed
RAW	topic2	-	Removed
RAW	topic3	-	Removed
RAW	status	successful	Renamed / Change in business logic : reverted (true), persistent (false)
RAW	order_index	order_index
DECODED	block	block_number	Renamed
DECODED	timestamp	block_timestamp	Renamed
DECODED	tx_hash	tx_hash
DECODED	log_index	log_index
DECODED	call_id	call_id
DECODED	contract_address	contract	Renamed
DECODED	contract_name	contract_name
DECODED	code_address	-	Removed
DECODED	event_signature	event_signature
DECODED	event_name	event_name
DECODED	parameters	parameters
DECODED	raw_paramters	-	Removed
DECODED	status	successful	Renamed / Change in business logic : reverted (true), persistent (false)
DECODED	order_index	order_index
DECODED	decoding_status	decoded	Renamed
DECODED	decoding_error	-	Removed

State_diffs

New Columns

Column Name	Data Type	Layer	Nullable	Definition
state_diff_id	text	TECH	NO	Technical field. Identifier of the state_diff, constructed by concatenating the block id and order index, separated by underscores.

Existing Columns

Schema - EDW BETA	Column - EDW BETA	Column - EDW	Changes & Comments
RAW	block	block_number	Renamed
RAW	timestamp	block_timestamp	Renamed
RAW	tx_hash	tx_hash	tx_hash
RAW	call_id	call_id	call_id
RAW	address	address	address
RAW	state_field	state_field	state_field
RAW	reason	reason	reason
RAW	prev_value	prev_value	prev_value
RAW	curr_value	curr_value	curr_value
RAW	status	reverted	Renamed / Change in business logic : reverted (true), persistent (false)
RAW	order_index	order_index	order_index

Storage_diffs

New Columns

Column Name	Data Type	Layer	Nullable	Definition
storage_diff_id	text	TECH	NO	Technical field. Identifier of the storage_diff, constructed by concatenating block id, order index and sequential number in a single diff (starting from 0)

Existing Columns

Schema - EDW BETA	Column - EDW BETA	Column - EDW	Changes & Comments
RAW	block	block_number	Renamed
RAW	block_hash	-	Removed
RAW	timestamp	block_timestamp	Renamed
RAW	tx_hash	tx_hash
RAW	canonical	-	Removed
RAW	call_id	call_id
RAW	contract	contract_address	Renamed
RAW	location	location
RAW	prev_value	prev_value
RAW	curr_value	curr_value
RAW	status	reverted	Renamed / Change in business logic : reverted (true), persistent (false)
RAW	order_index	order_index
RAW	load_id	-	Removed
DECODED	block	block_number	Renamed
DECODED	block_hash	-	Removed
DECODED	call_id	call_id
DECODED	canonical	-	Removed
DECODED	contract	contract_name	Renamed
DECODED	contract_address	contract_address
DECODED	curr_value	curr_value
DECODED	decoding_error	-	Removed
DECODED	decoding_status	decoded	Renamed
DECODED	field0	-	Removed
DECODED	field1	-	Removed
DECODED	key0	-	Replaced by hashmap_keys (json)
DECODED	key1	-	Replaced by hashmap_keys (json)
DECODED	key2	-	Replaced by hashmap_keys (json)
DECODED	key3	-	Replaced by hashmap_keys (json)
DECODED	load_id	-
DECODED	location	location
DECODED	order_index	order_index
DECODED	prev_value	prev_value
DECODED	raw_location	-	Removed
DECODED	slot	slot
DECODED	status	reverted	Renamed / Change in business logic : reverted (true), persistent (false)
DECODED	struct0	-	Replaced by structs (json)
DECODED	struct1	-	Replaced by structs (json)
DECODED	timestamp	block_timestamp	Renamed
DECODED	tx_hash	tx_hash
DECODED	variable	variable
DECODED	variable_type	variable_type

Transactions

New Columns

No new columns have been added to this table

Existing Columns

Schema - EDW BETA	Column - EDW BETA	Column - EDW	Changes & Comments
RAW	block	block_number	Renamed
RAW	timestamp	block_timestamp	Renamed
RAW	tx_index	tx_index
RAW	tx_hash	tx_hash
RAW	tx_type	tx_type
RAW	from_address	from_address
RAW	nonce	nonce
RAW	to_address	to_address
RAW	tx_value	tx_value
RAW	call_data	-	Removed
RAW	return_value	-	Removed
RAW	max_fee_per_gas	max_fee_per_gas
RAW	max_priority_fee_per_gas	max_priority_fee_per_gas
RAW	gas_limit	gas_limit
RAW	gas_price	gas_price
RAW	gas_used	gas_used
RAW	gas_refund	gas_refund
RAW	exception_error	exception_error
RAW	revert_reason	revert_reason
RAW	status	successful	Renamed / Change in business logic : reverted (true), persistent (false)
DECODED	block	block_number	Renamed
DECODED	timestamp	block_timestamp	Renamed
DECODED	tx_index	tx_index
DECODED	tx_hash	tx_hash
DECODED	tx_type	tx_type
DECODED	from_address	from_address
DECODED	from_name	from_name
DECODED	nonce	nonce
DECODED	to_address	to_addresss
DECODED	to_name	to_name
DECODED	tx_value	tx_value
DECODED	function_signature	-	Removed
DECODED	function_name	-	Removed
DECODED	arguments	-	Removed
DECODED	raw_arguments	-	Removed
DECODED	return_value	-	Removed
DECODED	max_fee_per_gas	max_fee_per_gas
DECODED	max_priority_fee_per_gas	max_priority_fee_per_gas
DECODED	max_priority_fee_per_data_gas	max_priority_fee_per_data_gas
DECODED	gas_limit	gas_limit
DECODED	gas_price	gas_price
DECODED	gas_used	gas_used
DECODED	gas_refund	gas_refund
DECODED	exception_error	exception_error
DECODED	revert_reason	revert_reason
DECODED	status	successful	Renamed / Change in business logic : reverted (true), persistent (false)
DECODED	decoding_status	decoded	Renamed
DECODED	decoding_error	-	Removed

Transfers

New Columns

No new columns have been added to this table.

Existing Columns

Schema - EDW BETA	Column - EDW BETA	Column - EDW	Changes & Comments
TOKENS	amount	amount
TOKENS	block_number	block_number
TOKENS	block_timestamp	block_timestamp
TOKENS	call_path	call_path
TOKENS	dec_amount	dec_amount
TOKENS	function_name	function_name
TOKENS	gas_used	gas_used
TOKENS	load_id	-	Removed
TOKENS	order_index	order_index
TOKENS	receiver	receiver
TOKENS	receiver_post_balance	receiver_post_balance
TOKENS	sender	sender
TOKENS	sender_post_balance	sender_post_balance
TOKENS	token_address	token_address
TOKENS	token_id	token_id
TOKENS	token_decimals	token_decimals
TOKENS	token_name	token_name
TOKENS	token_standard	token_standard
TOKENS	token_symbol	token_symbol
TOKENS	tx_function_name	tx_function_name
TOKENS	tx_hash	tx_hash
TOKENS	tx_receiver	tx_receiver

Tokens

New Columns

No new columns have been added to this table.

Existing Columns

Schema - EDW BETA	Column - EDW BETA	Column - EDW	Changes & Comments
TOKENS	load_id	-	Removed
TOKENS	address	token_address	Renamed
TOKENS	standard	token_standard	Renamed
TOKENS	symbol	token_symbol	Renamed
TOKENS	name	token_name	Renamed
TOKENS	decimals	token_decimals	Renamed