dartframe 0.7.0 changelog

0.7.0 #

[BREAKING CHANGE] Removed all geospatial features (GeoDataFrame, GeoSeries).
- REMOVAL: The GeoDataFrame and GeoSeries classes, along with all related spatial analysis methods, have been completely removed from the dartframe package.
- REASON: This change was made to streamline the core library, reduce its size, and separate concerns. Geospatial functionality is now housed in a dedicated, specialized package.
- MIGRATION: All geospatial features have been migrated to the new geoengine package. To continue using GeoDataFrame and GeoSeries, please add geoengine to your pubspec.yaml dependencies.
- You can find the new package here: geoengine on pub.dev.
- This move allows for more focused development on both the core data manipulation features in dartframe and the geospatial capabilities in geoengine.

0.6.3 #

[IMPROVEMENT] Improved dart format.

0.6.2 #

[IMPROVEMENT] Improved dart format.

0.6.1 #

[Fixed] Doc Strings.
[IMPROVEMENT] Improved dart format.

0.6.0 #

[FEATURE] Added comprehensive time series enhancements
- NEW: TimeSeriesIndex class for time-based indexing and operations
  - Support for timestamps with frequency information (Daily, Hourly, Monthly, Yearly)
  - Factory constructor TimeSeriesIndex.dateRange() for creating time series ranges
  - Automatic frequency detection with detectFrequency() method
  - Utility methods: slice(), contains(), indexOf(), asFreq() for frequency conversion
  - Support for empty time series with proper error handling
- NEW: FrequencyUtils class with time series utilities
  - Frequency normalization and validation (normalizeFrequency(), isValidFrequency())
  - Human-readable frequency descriptions (frequencyDescription())
  - Duration calculations for supported frequencies (getFrequencyDuration())
  - Support for frequency aliases (daily, hourly, monthly, yearly, annual)
- NEW: DataFrameTimeSeries extension for DataFrame time series operations
  - resample() method for changing time series frequency with aggregation functions
  - Support for multiple aggregation functions: mean, sum, min, max, count, first, last
  - upsample() method for increasing frequency with fill methods (pad/ffill, backfill/bfill, nearest)
  - downsample() method for decreasing frequency with aggregation
  - Automatic date column detection in DataFrames
  - Comprehensive error handling for edge cases and invalid inputs
- NEW: Comprehensive test coverage with 43 passing tests
  - Tests for TimeSeriesIndex constructor, properties, and utility methods
  - Tests for dateRange() factory constructor with various frequencies (D, H, M, Y)
  - Tests for frequency detection and validation functionality
  - Tests for DataFrame resampling, upsampling, and downsampling operations
  - Edge case testing for empty DataFrames, null dates, and mixed data types
  - Error handling validation for unsupported frequencies and methods
- ARCHITECTURE: Seamless integration with existing DataFrame and Series classes
- COMPATIBILITY: Pandas-like API for familiar time series operations
- PERFORMANCE: Efficient time-based operations with proper indexing
- All time series functionality follows pandas conventions for easy migration
[FEATURE] Added comprehensive categorical data support integrated directly into Series
- NEW: Series.astype('category') method for converting Series to categorical dtype (pandas-compatible)
- NEW: CategoricalAccessor (.cat) providing pandas-like categorical operations interface
- NEW: Efficient memory storage using integer codes with category labels mapping
- NEW: Support for both ordered and unordered categorical data types
- NEW: Category management operations:
  - series.cat.addCategories() - Add new categories to existing categorical data
  - series.cat.removeCategories() - Remove unused categories with validation
  - series.cat.renameCategories() - Rename categories using mapping dictionary
  - series.cat.reorderCategories() - Reorder categories and set ordered flag
- NEW: Categorical properties and methods:
  - series.cat.categories - Access category labels
  - series.cat.codes - Access integer codes
  - series.cat.ordered - Check if categories are ordered
  - series.cat.nCategories - Get number of categories
  - series.cat.unique() - Get unique categories present in data
  - series.cat.contains() - Check if categorical contains specific value
- NEW: series.isCategorical property to check if Series is categorical
- NEW: series.isCategoricalLike() method to detect categorical-suitable data
- NEW: series.seriesDtype property for pandas-like dtype information
- NEW: Enhanced series.dtype getter to handle categorical data types
- NEW: Seamless DataFrame integration - categorical Series work in all DataFrame operations
- NEW: Automatic data synchronization between categorical codes and Series values
- NEW: Type conversion support: 'category', 'object', 'int', 'float', 'string' dtypes
- ARCHITECTURE: Integrated approach - no separate CategoricalSeries class needed
- ARCHITECTURE: Internal _Categorical class for efficient categorical storage
- PERFORMANCE: Memory optimization - categorical encoding only when beneficial
- COMPATIBILITY: Full pandas API compatibility for categorical operations
- All existing Series methods (length, nunique, valueCounts, etc.) work seamlessly with categorical data
- Maintains backward compatibility - no breaking changes to existing Series functionality
[IMPROVEMENT] Improved performance optimizations
[FEATURE] Added comprehensive functions for missing data operations
- NEW: Complete test coverage for Series interpolation methods (linear, polynomial, spline)
- NEW: Extensive testing of enhanced fill operations (ffill, bfill) with limit parameters
- NEW: Missing data analysis accuracy validation using isna() and notna() methods
- NEW: Integration for combining interpolation, fill operations, and missing data detection
- NEW: Edge case testing for invalid parameters, insufficient data, and mixed data types
- NEW: Custom missing value handling across different scenarios (-999, 'NA', etc.)
- NEW: DataFrame-level missing data operations testing for multi-column scenarios
- Validates error handling, data preservation, and method parameter combinations
- Ensures robust behavior for complex missing data workflows and edge cases
[FEATURE] Added Shape class with multi-dimensional data structure support
- Supports both named access (shape.rows, shape.columns) and indexed access (shape[0], shape[1])
- Future-proofed for 3D+ data structures (tensors)
- Added utility methods: addDimension(), removeDimension(), transpose(), size, isEmpty, etc.
[FEATURE] Implemented comprehensive rolling window operations
- NEW: rollingWindow() method with pandas-like API for all columns simultaneously
- Basic operations: mean(), sum(), std(), variance(), min(), max()
- Advanced operations: median(), quantile(), skew(), kurt()
- Correlation operations: corr(), cov() with other DataFrames
- Custom functions: apply() method for user-defined operations
- Support for centered windows, minimum periods, and flexible parameters
[FEATURE] Implemented comprehensive statistical methods and consolidated statistical functions
- CONSOLIDATION: Moved all basic statistical functions from functions.dart to statistics.dart for better organization
  - Migrated count(), mean(), min(), max(), sum(), describe() with enhanced APIs
  - All functions now have consistent skipna parameter (defaults to true)
  - Improved error handling with ArgumentError instead of generic exceptions
  - Better missing value handling using internal _isMissing() method
  - Enhanced return types: dynamic for min/max/sum to handle missing values properly
- NEW: 19 additional statistical functions added to SeriesStatistics extension
- NEW: Basic Statistics Functions:
  - cumsum() - Cumulative sum over the Series with skipna support
  - nunique() - Count number of unique values with dropna parameter
  - value_counts() - Frequency count with normalize, sort, ascending, and dropna options
- NEW: Percentile Functions:
  - percentile() - Alternative to quantile using 0-100 scale for easier interpretation
  - iqr() - Interquartile Range (Q3 - Q1) for measuring statistical dispersion
- NEW: Advanced Statistics Functions:
  - sem() - Standard Error of the Mean with configurable degrees of freedom
  - mad() - Mean Absolute Deviation for robust central tendency measurement
  - range() - Range (max - min) for measuring data spread
- NEW: Correlation and Covariance Functions:
  - corr() - Pearson correlation coefficient with another Series
  - cov() - Covariance with another Series and configurable degrees of freedom
  - autocorr() - Autocorrelation with configurable lag periods for time series analysis
- NEW: Rank and Order Statistics Functions:
  - rank() - Rank values with 5 tie-breaking methods ('average', 'min', 'max', 'first', 'dense')
  - pct_change() - Percentage change between consecutive values for time series analysis
  - diff() - Difference between consecutive values with configurable periods
- NEW: Robust Statistics Functions:
  - trimmed_mean() - Mean after removing outliers from both tails (configurable proportion)
  - winsorized_mean() - Mean after capping outliers at boundary values
- NEW: Distribution Functions:
  - entropy() - Shannon entropy with configurable logarithm base for information theory
  - geometric_mean() - Geometric mean for positive values (nth root of product)
  - harmonic_mean() - Harmonic mean for positive values (reciprocal of arithmetic mean of reciprocals)
- ENHANCEMENT: All statistical functions feature:
  - Consistent API design with skipna parameters
  - Comprehensive documentation with mathematical explanations and examples
  - Proper edge case handling (empty data, insufficient samples, non-numeric data)
  - Return double.nan or _missingRepresentation for invalid cases instead of throwing exceptions
  - Full integration with existing Series functionality and DataFrame operations
- PERFORMANCE: Optimized mathematical operations using dart:math library functions
- COMPATIBILITY: Pandas-like API for familiar data science workflows
- ARCHITECTURE: Over 40 statistical functions now available in Series class
- Fixed broken describe() function that was calling undefined std() and quantile() methods
- Removed duplicate cumsum() function from functions.dart to avoid conflicts
- All existing tests pass with enhanced statistical functionality
[DEPRECATION] Deprecated single-column rolling() method in favor of rollingWindow()
- Added migration guide and compatibility documentation
- Maintained backward compatibility for existing code
- Enhanced performance for multiple rolling operations
[FEATURE] Added comprehensive data reshaping and manipulation extensions
- NEW: DataFrameReshaping extension with advanced reshaping operations
  - stack() and unstack() methods for hierarchical indexing and multi-level data structures
  - Enhanced meltEnhanced() method with additional pandas-like parameters (ignoreIndex, colLevel)
  - widen() method as intuitive inverse of melt for long-to-wide format conversion
  - Corrected transpose() method with proper matrix transposition logic
- NEW: Enhanced pivot table functionality
  - pivotTableEnhanced() with support for multiple index and column levels
  - crosstab() method for cross-tabulation analysis with margins and normalization
  - Advanced aggregation options and margin calculations
- NEW: DataFrameMerging extension with enhanced join operations
  - merge() method with pandas-like parameters and validation options
  - concat() method for concatenating DataFrames with flexible options
  - joinEnhanced() method with additional join strategies
  - Merge validation (one-to-one, one-to-many, many-to-one, many-to-many)
  - Framework for mergeAsof() (asynchronous merge operations)
[ARCHITECTURE] Maintained dual approach for reshaping methods
- functions.dart: Contains standard, fully functional methods (melt, pivotTable, join)
- reshaping.dart: Contains enhanced versions with "Enhanced" suffixes (meltEnhanced, pivotTableEnhanced, joinEnhanced)
- Users can choose between standard functionality or enhanced features
- No breaking changes - both approaches coexist for maximum compatibility
[FIX] Corrected transpose method implementation
- Fixed incorrect column structure that was using index values as column names
- Implemented proper matrix transposition where columns become rows and vice-versa
- Added proper copy logic with _copyValue() helper for different data types
- Enhanced documentation with clear examples of transpose behavior

0.5.5 #

[FEATURE] Changed to MIT License

0.5.4 #

[IMPROVEMENT] Cleaned code

0.5.3 #

[IMPROVEMENT] Cleaned code

0.5.2 #

[FIX] Fixed FileIO not exported

0.5.1 #

[IMPROVEMENT] Cleaned code
[IMPROVEMENT] Added documentation strings to functions and classes
[FIX] Moved all experiments to new branch
[IMPROVEMENT] Updated README and improved documentation
[FEATURE] Add quantile calculation with tests for edge cases

0.5.0 #

[IMPROVEMENT] Reorganize codebase into discrete libraries and update dependencies
[IMPROVEMENT] Restructure into separate library with parts
[IMPROVEMENT] Cleaned code base
[IMPROVEMENT] Refactor(utils): make functions public and remove main test
[IMPROVEMENT] Chore(dependencies): update intl and geoxml versions

0.4.5 #

[Fix] fix formatting and indentation in multiple files

0.4.4 #

[Fix] Refactor(geo_series): rename snake_case methods to camelCase for consistency

0.4.3 #

[Fix] Formatted files.
[IMPROVEMENT] Reorganize test files into dataframe_series directory
[IMPROVEMENT] Rename geoJSONToGEOS to GeoJSONToGEOS for consistency fix(geo_series)
[IMPROVEMENT] Specify Series return type for isEmpty getter chore(dartframe)
[IMPROVEMENT] Add dart:ffi import and include src/utils/lists.dart fix(series)
[IMPROVEMENT] Change default errors parameter to 'ignore' in toNumeric refactor(string_accessor)
[IMPROVEMENT] Improve split pattern handling with n parameter

0.4.2 #

[Fix] Formatted files.

0.4.1 #

[Fix] Fixed readme.

0.4.0 #

[FEATURE] Added main library file lib/dartframe.dart exporting library parts and initializing fileIO.
[FEATURE] Implemented DataFrameILocAccessor and DataFrameLocAccessor in lib/src/dart_frame/accessors.dart for integer and label-based data selection in DataFrames.
[FEATURE] Implemented core DataFrame class in lib/src/dart_frame/dart_frame.dart with constructors, data cleaning, accessors, and string representation.
[FEATURE] Added extensive DataFrame manipulation functions in lib/src/dart_frame/functions.dart (selection, filtering, sorting, stats, transformations, I/O, grouping).
[FEATURE] Implemented DataFrame operator overloads ([], []=) in lib/src/dart_frame/operations.dart.
[FEATURE] Added file I/O abstraction (FileIOBase) with platform-specific implementations in lib/src/file_helper/.
[FEATURE] Implemented core Series class in lib/src/series/ for 1D arrays, with constructors, operators, statistical functions, string accessor, and date/time conversions.
[DOCS] Added markdown documentation for DataFrame, GeoDataFrame, GeoSeries, and Series classes in docs/.
[DOCS] Added example/example.dart demonstrating DataFrame and Series usage.
[DOCS] Added example/geodataframe_example.dart demonstrating GeoDataFrame usage.
[DOCS] Added example/geoseries.dart demonstrating GeoSeries usage.
[MISC] Added output.geojson example output file.
[TEST] Added a suite of unit tests in test/ covering DataFrame and Series functionalities.
[DOCS] Added bin/dartframe.dart as a simple executable example.

0.3.4 #

[Fixed] Doc Strings.
[IMPROVEMENT] Improved dart format.

0.3.3 #

[Fixed] Doc Strings.

0.3.2 #

[IMPROVEMENT] Migrated to WASM.

0.3.1 #

[Fix] Fixed readme.

0.3.0 #

[Fix] Fixed readme.
[FEATURE] Added more properties
[FIX] Fixed DataFrame constructor to create modifiable column lists, allowing column addition after initialization
[FIX] Updated Series toString() method to properly display custom indices
[FEATURE] Added GeoSeries class for spatial data analysis
[FEATURE] Added GeoSeries.fromXY() factory constructor to create point geometries from x, y coordinates
[FEATURE] Added GeoSeries.fromWKT() factory constructor to create geometries from WKT strings
[FEATURE] Added GeoSeries.fromFeatureCollection() factory constructor to create geometries from GeoJSON
[FEATURE] Added spatial analysis methods to GeoSeries:
- getCoordinates() - extracts coordinates as a DataFrame
- countCoordinates - counts coordinate pairs in each geometry
- countGeometries - counts geometries in multi-part geometries
- countInteriorRings - counts interior rings in polygonal geometries
- isClosed - checks if LineStrings are closed
- isEmpty - checks if geometries are empty
- isRing - checks if features are rings
- isValid - validates geometry structures
- hasZ - checks for 3D coordinates
- bounds - gets bounding boxes for geometries
- totalBounds - gets overall bounds of all geometries
- centroid - calculates centroids of geometries
- type - gets geometry types
- area - calculates areas of polygonal geometries
- lengths - calculates lengths of linear geometries
- isCCW - checks if rings are counterclockwise
- contains - checks spatial containment relationships
[IMPROVEMENT] Enhanced Series class to support custom indices similar to DataFrame
[IMPROVEMENT] Renamed DataFrame's rowHeader to index for consistency with pandas API
[IMPROVEMENT] Updated DataFrame constructor to accept index parameter

0.2.2 #

[Fix] Fixed readme.
[FEATURE] Added topics to the package/library

0.2.1 #

[Fix] Fixed readme.

0.2.0 #

[FEATURE] Added isEmpty and isNotEmpty properties to check if DataFrame has rows
[FEATURE] Added copy() method to create deep copies of DataFrames
[FEATURE] Added dimension properties: rowCount, columnCount, and shape
[FEATURE] Added dtypes property to get column data types
[FEATURE] Added hasColumn() method to check for column existence
[FEATURE] Added unique() method to get DataFrame with only unique rows
[FEATURE] Added unique() method to Series to get unique values
[FEATURE] Added resetIndex() method for reindexing after filtering
[FEATURE] Added conversion methods: toListOfMaps() and toMap()
[FEATURE] Added sample() method for randomly sampling rows
[FEATURE] Added applyToColumn() method for applying functions to column elements
[FEATURE] Added applyToRows() method for applying functions to each row
[FEATURE] Added corr() method for computing correlation coefficients
[FEATURE] Added bin() method for creating bins from continuous data
[FEATURE] Added toCsv() method for converting DataFrame to CSV string
[FEATURE] Added pivot() method for creating pivot tables
[FEATURE] Added melt() method for reshaping data from wide to long format
[FEATURE] Added join() method for combining DataFrames
[IMPROVEMENT] Enhanced fillna() method with strategies (mean, median, mode, forward, backward)
[FEATURE] Added dropna() method to remove rows or columns with missing values
[IMPROVEMENT] Improved replace() method with regex support and column targeting
[FEATURE] Added replaceInPlace() method for in-place value replacement
[FEATURE] Added astype() method to convert column data types
[FEATURE] Added round() method to round numeric values to specified precision
[FEATURE] Added rolling() method for computing rolling window calculations
[FEATURE] Added cumulative() method for cumulative calculations (sum, product, min, max)
[FEATURE] Added quantile() method to compute quantiles over a column
[FEATURE] Added rank() method to compute numerical rank along a column
[FEATURE] Added abs() method to Series for calculating absolute values
[FEATURE] Added copy() method to Series for creating copies
[FEATURE] Added cummax() method to Series for cumulative maximum calculations
[FEATURE] Added cummin() method to Series for cumulative minimum calculations
[FEATURE] Added cumprod() method to Series for cumulative product calculations
[IMPROVEMENT] Enhanced cumsum() method in Series with skipna parameter
[FEATURE] Added GeoDataFrame class for handling geospatial data
[Fix] Fixed the ability to modify individual elements in DataFrame using df['column'][index] = value syntax
[FIX] Improved row header display in toString() method to properly handle headers of varying lengths

0.1.3 #

[IMPROVEMENT] Fixed Readme not showing the right status
[FEATURE] Added unit tests
[FEATURE] Added row header names/index

0.1.2 #

Fixed description to match dart packaging

0.1.1 #

Fixed description.

0.1.0 #

Initial version.

dartframe 0.7.0
dartframe: ^0.7.0 copied to clipboard

Metadata

0.7.0 #

0.6.3 #

0.6.2 #

0.6.1 #

0.6.0 #

0.5.5 #

0.5.4 #

0.5.3 #

0.5.2 #

0.5.1 #

0.5.0 #

0.4.5 #

0.4.4 #

0.4.3 #

0.4.2 #

0.4.1 #

0.4.0 #

0.3.4 #

0.3.3 #

0.3.2 #

0.3.1 #

0.3.0 #

0.2.2 #

0.2.1 #

0.2.0 #

0.1.3 #

0.1.2 #

0.1.1 #

0.1.0 #

← Metadata

Publisher

Weekly Downloads

Metadata

Topics

Documentation

License

Dependencies

More

dartframe 0.7.0 dartframe: ^0.7.0 copied to clipboard

Metadata

0.7.0 #

0.6.3 #

0.6.2 #

0.6.1 #

0.6.0 #

0.5.5 #

0.5.4 #

0.5.3 #

0.5.2 #

0.5.1 #

0.5.0 #

0.4.5 #

0.4.4 #

0.4.3 #

0.4.2 #

0.4.1 #

0.4.0 #

0.3.4 #

0.3.3 #

0.3.2 #

0.3.1 #

0.3.0 #

0.2.2 #

0.2.1 #

0.2.0 #

0.1.3 #

0.1.2 #

0.1.1 #

0.1.0 #

← Metadata

Publisher

Weekly Downloads

Metadata

Topics

Documentation

License

Dependencies

More

dartframe 0.7.0
dartframe: ^0.7.0 copied to clipboard