What is a good approaching for tracking incremental changes to database tables, stored procedures, etc for Azure SQL Data Warehouse? I am in the process of moving a large database over to Azure SQL Data Warehouse. The prior approach for change tracking was using a 'Database Project' in Visual Studio 2015. This allows easy source control integration with TFS or Git or whatever. When you want to publish, you just target the destination database and it generates a change script. This functionality does not at all work for Azure SQL Data Warehouse. Visual Studio (and the latest SSDT) simply can't target SQL DW. This means the process of publishing is extremely tedious, entirely manual and extremely error prone. Is there another comparable approach you are using for this type of project?

We are migrating our database to a new schema but want to validate the data has been moved correctly. Traditional data comparison tools can compare two databases for differences if the schemas are the same. In our case there have been changes to the table designs but all the data from the old schema is in the new one, it's just been moved around a bit, and I need to make sure it is correct. We have tens of millions of rows so manual inspection is not an option. Are there any tools which could aid in this type of comparison? If not are there any libraries/frameworks which could help kick start the development of a custom solution? I'm happy to use a database specific solution if necessary, in this case for SQL Server 2008. **My soluton:** I'm comparing the two data sets by creating a VIEW of each table on the old database with the same fields as the new database table. I then compare the data using the technique described here: The shortest, fastest, and easiest way to compare two tables in SQL Server: UNION ! I'm lucky in this migration as the overall table structure is similar to the old database, with fields moved from one table to another, dropped or added. In the case of the dropped and added there is nothing to compare, for the fields which have moved or been aggregated I do calculations in the view to provide the correct information for comparison. The UNION comparison shows me only the rows with differences, so as soon as the data is correct I get an empty result set.

I am working in several projects where every one has its own database connections. So far, I have been using DBeaver, adding the connections by hand, but at the end, having the connections, data, SQL scripts, tabs, etc. for all the projects in the same place results in a chaotic environment. So, I am trying to create a tool able to launch DBeaver which the configuration (i.e. connections) specific to a project. Looking at the [docs](https://dbeaver.com/docs/dbeaver/Command-Line/#command-line-parameters) , it should be an easy task, but I can not get it to work. I have tried multiple combinations of parameters for the -con argument (create, save, connect, openConsole, url, folder, database, etc.) but I am not able to open dbeaver UI with a new connection. For instance:

dbeaver-ce   \
  -data .    \
  -con "driver=sqlite|database=one.sqlite|folder=/home/salva/projects/one|name=one|openConsole=true|connect=true|save=true|create=true" \
  -f

I am unable to find the exact spell that would make it work and would appreciate any advice on the matter! **Update**: It seems it was a PEBCAK, I had not noticed I already had a DBeaver instance open in another workspace, and because of that, nothing was apparently happening when I run the command with the new connection, I found that adding the -f flag (without its required argument), would made DBeaver to appear but then, -con was not handled, probably because of the broken -f! In any case, it is working now!

Need help in finding out Free Tool for firebird 2.0 database? Can anyone has idea for this tool availability and link? I have database in Windows Platform and I have few store procedure written there

I just took over a medium-sized postgres database and the team has been surprised with many tables hitting their auto-incrementing id int max limits which triggered unscheduled downtime to fix. Does anyone know of a simple tool to help check all tables/columns and easily find which are at risk of hitting the int max limits? I'm sure we can come up with a script to check, but I remember reading somewhere of a tool to help me identify potential issues exhaustively.

While developing on MySQL I really miss being able to fire up a profiler. I find SQLyog is a good enough replacement for Query Analyzer but have not found a tool that works like SQL profiler. For the MySQL folk who have not seen Microsoft's SQL Profiler , here is a screenshot At my previous job we had a tool that trumped SQL Profiler and even gave us stack traces Does anyone know of any tools like the ones I mentioned that works with MySQL. (FYI, I can get the Altiris Profiler to work with MySQL but it will involve running Windows furthermore its not really a Symantec sku so licensing is really tricky)

I was watching a 7 years old webinar done by Brent Ozar (https://youtu.be/U_Kle3gKaHc) , and heard of several items being recommended at that time. 1. SQLDiag utility. 2. SQLNexus. 3. PAL tool. 4. Database Tuning Advisor/wizard. 5. BPA (Best Practices Analyzer). 6. SQL Server Policy Based Management. Are all of them still to be used/considered or there is something newer that replaced them?

When I log in with psql --username=postgres, how do I list all databases and tables? I have tried \d, d and dS+ but nothing is listed. I have created two databases and a few tables with pgAdmin III, so I know they should be listed.

**Hello Everyone** I am new in databases and i am trying to understand some Cassandra commands. I would like to know about the following commands : - nodetool compact - nodetool cleanup - nodetool repair - nodetool garbagecollect I would appreciate some simple and clear answers like -> nodetool help : it shows all the commands and their usage. >The problem i am trying to solve is that after i delete (a lot of data) the storage is still full. I change the gc_grace_seconds to 1 day and still nothing. So if i need to clear the space manualy right now which commands should i run and in what order? *Thanks for your time*

I know that psql is an option, but I'm looking for an easier text-based interface for PostgreSQL. Something that's similar to what 'tig' is to 'git', or 'phpmyadmin' is to 'mysql' (but using the command line). does any one know something like this?

My current project involves a lot of database shuffling as we upgrade from SQL 2008 -> 2012, re-task hardware, repeat. One minor annoyance is the connection dialog in SSMS re-shuffling the server order to put the most recent on top. Given that on any particular day I'm connecting to 6-10 DB servers and want to quickly find a specific one in the list, this behavior is much more of a hindrance than a help. Is there a way to disable this behavior, having the servers listed alphabetically, or in the order they were added...or *anything* that doesn't change every time I connect to a server? Barring that, is there an *entirely different* way to better manage connecting to a specific server from a list/farm of them? I'm using SSMS for SQL 2012 (though I'm curious about 2008 solutions as well).

Disclaimer: I do not intend this to be a question based on opinion and start data wars (I don't know if such things exist in this realm unlike software development and programming languages) What I want: I want a piece of software (hopefully free, I am a student) that does not necessarily have to come with all the bells and whistles of professional data suites, but one that will allow me to: - create ERDs - design my databases, tables, fields, - create primary keys, link foreign keys - visualize relations b/w tables Most of what I have found such as erwin Data Modeler have free trials only. Once again, its not about the bells and whistles since I am what you could call a beginner. I have a personal desktop app I am working on and I don't want to keep looking at the code to remember the tables nor keep opening SQLITE DB Browser. Any sense of direction would be appreciated.

Sysadmin here, I'm wondering what tools you all use to manage large scale automation tasks with powershell. I currently have several powershell scripts that are regularly used, but do not interact or call each other. I'm looking for a GUI interface to help make sense of it, and grab variables as outputs from one script into another. I can do all this through powershell alone, but wondering if there's a more visual way to set up the complex interactions between scripts. An example of a process that would need to be completed: 1. SQL backup taken on hosted client server 2. Backup uploaded to FTP Site 3. Backup loaded to data scrubbing server 4. Backup restored to local SQL Instance 5. Client sensitive info scrubbed 6. Backup taken and uploaded to NAS 7. NAS backup restored to local support environment 8. Database modified to add users for WinAuth 9. Various server config on support environment for our software

Visual Studio 2010 introduces database projects and a whole array of related features that supposedly facilitate database development. I've used SQL Server Management Studio (SSMS) for many years to do my database development without issue. - Why should I bother with VS2010 when SSMS works for me? What, specifically, does it do better than SSMS? - But perhaps my premise is incorrect and SSMS still trumps VS for database development. If so, in what specific ways is that true?

For audit purposes, I'm trying to obtain a copy/export of a DB but including only the rows from each table that have relevance to a small collection of rows in some table. So every row of every table that these rows point to; every row of every table that points to these rows; and so forth. (In algebra terms this is the transitive-symmetric-reflexive closure of those rows with respect to the foreign key relation.) I'm wondering if there exists some kind of tool to do this, or if this is scriptable somehow. I have ~400 tables with a tight network of foreign keys so I'd rather not do this by hand.

What's a good workbench tool for sqlite similar to MySQLWorkbench for MySQL? I'm used to MySQLWorkbench for working with MySQL databases. Now I have some sqlite databases to work with and would like to find a similar tool.

I am interested in a free and simple MySQL tool which can offer online collaboration functionality in creating database general schema. Do you know any?

I have a query with a subquery, both are fast but when combined they take forever (meaning whatever time above what is acceptable in my application). I tried using 'explain' to see what's going on, it didn't help me much. What other ways are there to investigate slow queries? Below are the specific details of my problem. I have a list of products, I want to find the date of the first vendor event for each product. If I get the list of event IDs, the query goes fast (each product might have multiple events, they are created in chronological order so min event ID is the earliest; ProdID is indexed); then I use this list of event IDs to get the date, this second query goes fast too (event ID is the primary key, therefore indexed). But if I use the first query as a subquery of the second, it takes forever. Query 1: mysql> select min(VendorEventID) from Vendor_Events where ProdID in (598446938, 598446984, 598447024, 598447054, 598447311, 598447523, 598447764, 598447778, 598448000, 598448048) and vendorid = 12 group by ProdID ; +--------------------+ | min(VendorEventID) | +--------------------+ | 11217790121 | | 11217792453 | | 11217793912 | | 11217793894 | | 11217794825 | | 11217815018 | | 11217813148 | | 11217828936 | | 11217830215 | | 11217829202 | +--------------------+ 10 rows in set (0.00 sec) Query 2: mysql> select * from Vendor_Events where VendorEventID in ( 11217790121, 11217792453, 11217793912, 11217793894, 11217794825, 11217815018, 11217813148, 11217828936, 11217830215, 11217829202 ) ; +---------------+----------+-----------+---------------------+------------+--------+ | VendorEventID | VendorID | ProdID | LoggedDate | VendorType | NameID | +---------------+----------+-----------+---------------------+------------+--------+ | 11217790121 | 12 | 598446938 | 2016-12-07 16:33:58 | 2 | 32 | | 11217792453 | 12 | 598446984 | 2016-12-07 16:34:14 | 2 | 32 | | 11217793894 | 12 | 598447054 | 2016-12-07 16:34:29 | 2 | 32 | | 11217793912 | 12 | 598447024 | 2016-12-07 16:34:29 | 2 | 32 | | 11217794825 | 12 | 598447311 | 2016-12-07 16:34:33 | 2 | 32 | | 11217813148 | 12 | 598447764 | 2016-12-07 16:37:10 | 2 | 32 | | 11217815018 | 12 | 598447523 | 2016-12-07 16:37:24 | 2 | 32 | | 11217828936 | 12 | 598447778 | 2016-12-07 16:39:54 | 2 | 32 | | 11217829202 | 12 | 598448048 | 2016-12-07 16:39:55 | 2 | 32 | | 11217830215 | 12 | 598448000 | 2016-12-07 16:40:04 | 2 | 32 | +---------------+----------+-----------+---------------------+------------+--------+ 10 rows in set (0.04 sec) Explain them combined: mysql> explain select * from Vendor_Events where VendorEventID in ( select min(VendorEventID) from Vendor_Events where ProdID in (598446938, 598446984, 598447024, 598447054, 598447311, 598447523, 598447764, 598447778, 598448000, 598448048) and vendorid = 12 group by ProdID ) ; +----+--------------------+---------------+-------+-----------------+----------+---------+------+----------+--------------------------+ | id | select_type | table | type | possible_keys | key | key_len | ref | rows | Extra | +----+--------------------+---------------+-------+-----------------+----------+---------+------+----------+--------------------------+ | 1 | PRIMARY | Vendor_Events | ALL | NULL | NULL | NULL | NULL | 78536406 | Using where | | 2 | DEPENDENT SUBQUERY | Vendor_Events | range | ProdID,ProdID_2 | ProdID_2 | 16 | NULL | 15 | Using where; Using index | +----+--------------------+---------------+-------+-----------------+----------+---------+------+----------+--------------------------+ 2 rows in set (0.00 sec) Of course if anyone can help me figure out what's causing the query to be super slow, I'd appreciate. But if people want to tell me what other ways are there to investigate slow queries, I'd like that too, since we all face slow queries every now and then. ;-)

I set up pgBackRest and PostgreSQL configuration in two different servers. I set up with crontab one full backup a week and one differential backup a day.

0  1   *   *   0     pgbackrest --type=full --stanza=stanzaname backup  
0  1   *   *   1-6   pgbackrest --type=diff --stanza=stanzaname backup

I set up retention as below to save disk usage:

repo1-retention-full=2  
repo1-retention-diff=1
repo1-retention-archive-type=full

Is it possible to ensure PITR to cover up to 2 weeks with this retention configuration? If yes, is there a benefit to set a differential retention more than 1? Because keeping more differential backups could consume a lot of disk space.

I am using VS2010 and MySQL for my project. My client wantw to take mysqldump every day like a daily backup. I want to give my client a tool for taking mysqldumps on a particular time schedule. Do you know any tool that can fulfill my requirement?